00000001:02000400:3.0F:1787384194.381203:0:2960:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_hostid 00000001:02000400:2.0F:1787384215.570677:0:3181:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1787384217.388396:0:3223:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 511 MB/s 00000001:01000000:1.0F:1787384217.638317:0:3223:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 767 MB/s 00000001:01000000:1.0:1787384217.887919:0:3223:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 9043 MB/s 00000020:02000000:3.0:1787384218.887741:0:3273:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_113_ga48d3e3 00000400:02000000:0.0F:1787384220.101549:0:3288:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.203.151@tcp [8/256/0/180] 00008000:02000000:2.0:1787384224.125464:0:3438:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787384276.379164:0:5247:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1787384286.106842:0:5763:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787384286.106848:0:5763:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1787384286.107164:0:5763:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 0000000017c63a8a 00000080:02000400:1.0:1787384286.107178:0:5763:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1787384286.115444:0:5763:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1787384286.115461:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787384286.115509:0:5763:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000007889caa6) 00000020:00000080:1.0:1787384286.115540:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787384286.149409:0:5763:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787384286.150166:0:5763:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787384286.188188:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787384286.188292:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787384286.188314:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787384286.188362:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787384286.188382:0:5763:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787384286.189814:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787384286.189824:0:5763:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787384286.189837:0:5763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c303f 00000020:01000004:2.0:1787384286.189845:0:5763:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787384286.189850:0:5763:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787384286.189855:0:5763:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000017c63a8a from MGS 00000020:01000004:2.0:1787384286.189890:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787384286.189914:0:5763:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f371b624) 00000020:00000080:2.0:1787384286.189928:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787384286.190111:0:5763:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000017c63a8a from MGS, refs=2 00080000:01000000:2.0:1787384286.190117:0:5763:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787384286.190122:0:5763:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c304d 00000100:00100000:2.0:1787384286.190308:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787384286.190425:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787384286.190431:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787384286.194340:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787384286.194363:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787384286.196375:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384286.196821:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787384286.196829:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787384286.198275:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787384286.198286:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787384286.199076:0:5763:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787384286.199085:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787384286.202823:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384286.202829:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384286.202831:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384286.204391:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384286.204396:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384286.204398:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384286.212187:0:5763:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787384286.216716:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1787384286.462083:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1887 MB/s 00000001:01000000:0.0:1787384286.712603:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3143 MB/s 00000001:01000000:0.0:1787384286.964184:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 432 MB/s 00000001:01000000:2.0:1787384287.215798:0:5763:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 705 MB/s 00080000:10000000:3.0:1787384287.237495:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:0.0:1787384287.242096:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787384287.274078:0:5763:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787384287.274095:0:5763:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787384287.274098:0:5763:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787384287.285465:0:5774:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1787384287.285624:0:5763:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1787384287.285694:0:5763:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1787384287.286008:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1787384287.286038:0:5763:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787384287.286471:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384287.286631:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787384287.286637:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787384287.296977:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787384287.296999:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787384287.298043:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787384287.298052:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1787384287.300124:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1787384287.300159:0:5763:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.151@tcp' 00000020:01000004:0.0:1787384287.300161:0:5763:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1787384287.300219:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.151@tcp (typ=mgc) 00000020:00000080:0.0:1787384287.300260:0:5763:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.151@tcp (00000000c67a9995) 00000020:00000080:0.0:1787384287.300559:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1787384287.300705:0:5763:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000974c1718@MGC192.168.203.151@tcp: add connection 192.168.203.151@tcp at head 00000100:00080000:3.0:1787384287.301566:0:5779:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00010000:00010000:0.0:1787384287.301839:0:5763:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.151@tcp-0 is initialized 00000040:01000000:0.0:1787384287.301846:0:5763:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 1 is initialized 10000000:01000000:1.0:1787384287.318436:0:5780:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1787384287.322549:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.151@tcp (uuid 0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9) 00000020:00000080:0.0:1787384287.322588:0:5763:0:(genops.c:1406:class_connect()) connect: client 0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9, cookie 0x3522fbed3b6c305b 00000100:00080000:0.0:1787384287.322601:0:5763:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384287.323275:0:5763:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import 00000000974c1718 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1787384287.323446:0:5763:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000096b3d029 x1874208195870848/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384287.323478:0:5763:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9->MGS 00000020:01000004:1.0:1787384287.323530:0:5763:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787384287.323537:0:5763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787384287.323552:0:5763:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000000fd03cda) 00000020:00000080:1.0:1787384287.323567:0:5763:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1787384287.324154:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096b3d029 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3303:1874208195870848:0@lo:250: 00000100:00100000:2.0:1787384287.324239:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384287.324331:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195870848 00000100:00100000:2.0:1787384287.324339:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195870848 00000100:00100000:2.0:1787384287.324367:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384287.324373:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009844a9c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1874208195870848:12345-0@lo:250: 00010000:00080000:2.0:1787384287.324396:0:5776:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9@0@lo t0 exp 0000000000000000 cur 148 last 0 00000020:00000080:2.0:1787384287.324430:0:5776:0:(genops.c:1406:class_connect()) connect: client 0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9, cookie 0x3522fbed3b6c3069 00000100:00080000:2.0:1787384287.324684:0:5776:0:(import.c:65:import_set_state_nolock()) 000000008c3da69f : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384287.324736:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009844a9c3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+5:3303:x1874208195870848:12345-0@lo:250: Request processed in 362us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384287.324744:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384287.324793:0:3303:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1787384287.324801:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.151@tcp: connect to target with instance 0 00000100:00080000:2.0:1787384287.324809:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1787384287.324814:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1787384287.324818:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000974c1718 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1787384287.324820:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1787384287.324841:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1787384287.324847:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096b3d029 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3303:1874208195870848:0@lo:250: 00000100:00100000:1.0:1787384287.342263:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384287.342458:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787384287.342465:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1787384287.343554:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1787384287.343565:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787384287.344180:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787384287.344189:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787384287.345642:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384287.346192:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787384287.346200:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1787384287.347412:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1787384287.347423:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787384287.412488:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384287.413118:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787384287.413125:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787384287.419813:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787384287.419831:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1787384287.433830:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384287.434301:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787384287.434307:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1787384287.435348:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787384287.435359:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1787384287.436190:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384287.436396:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787384287.436401:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787384287.437370:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787384287.437378:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1787384287.443194:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384287.443616:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1787384287.443628:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787384287.444600:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787384287.444610:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787384287.475443:0:5763:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384287.475994:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787384287.476002:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787384287.481644:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787384287.481663:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1787384287.484123:0:5763:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787384287.484141:0:5763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1787384287.486461:0:5763:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1787384287.486489:0:5763:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1787384287.486495:0:5763:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1787384287.486810:0:5763:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787384287.486853:0:5763:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.151@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1787384287.486888:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787384287.486890:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384287.486892:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384287.486893:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384287.486894:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384287.486895:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384287.486896:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384287.486897:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384287.486898:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384287.486900:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384287.486901:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384287.486902:0:5763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384287.486909:0:5763:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1787384287.486911:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384287.486912:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384287.486913:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384287.486914:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384287.486915:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384287.486916:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384287.486916:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384287.486917:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384287.486918:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384287.486919:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384287.486920:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384287.486921:0:5763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384287.486953:0:5763:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1787384287.486969:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006990f3b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195870976:0@lo:253: 00000100:00100000:3.0:1787384287.487035:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384287.487152:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 0000000012c85952 going to sleep for 11 seconds 00000100:00100000:1.0:1787384287.487379:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195870976 00000100:00100000:1.0:1787384287.487386:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195870976 00000100:00100000:1.0:1787384287.487465:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384287.487473:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002d80bbde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+5:5763:x1874208195870976:12345-0@lo:253: 20000000:01000000:1.0:1787384287.487507:0:5778:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787384287.487516:0:5778:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1787384287.491206:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787384287.491657:0:5778:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787384287.491994:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384287.493282:0:5800:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787384287.493678:0:5778:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787384287.493682:0:5778:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787384287.493688:0:5778:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787384287.493690:0:5778:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787384287.493705:0:5778:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787384287.493929:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384287.494160:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787384287.494173:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787384287.494236:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787384287.494294:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787384287.494333:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787384287.494419:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787384287.494429:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787384287.494482:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787384287.494492:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787384287.494526:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787384287.494553:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787384287.494600:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787384287.494654:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787384287.494695:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787384287.494700:0:5778:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787384287.494714:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384287.494962:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:3.0:1787384287.494972:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1787384287.495005:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:3.0:1787384287.495039:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:3.0:1787384287.495085:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:3.0:1787384287.495096:0:5778:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:3.0:1787384287.495163:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:3.0:1787384287.495172:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787384287.495213:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:3.0:1787384287.495251:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:3.0:1787384287.495288:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:3.0:1787384287.495298:0:5778:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:3.0:1787384287.495400:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:3.0:1787384287.495410:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:3.0:1787384287.495443:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:3.0:1787384287.495478:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:3.0:1787384287.495620:0:5778:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:3.0:1787384287.495659:0:5778:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:3.0:1787384287.495679:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1787384287.508385:0:5801:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:3.0:1787384287.513501:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:3.0:1787384287.513539:0:5778:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.151@tcp for mdt 20000000:01000000:3.0:1787384287.513542:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:3.0:1787384287.513577:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:3.0:1787384287.513587:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:3.0:1787384287.513619:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:3.0:1787384287.513627:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:3.0:1787384287.513724:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:3.0:1787384287.513803:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:3.0:1787384287.513842:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:3.0:1787384287.514096:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:3.0:1787384287.514181:0:5778:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:3.0:1787384287.514185:0:5778:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1787384287.514188:0:5778:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1787384287.514212:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787384287.514215:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787384287.514245:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787384287.514248:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787384287.516237:0:5802:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1787384287.520087:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1787384287.520146:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1787384287.520235:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1787384287.520250:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787384287.520253:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787384287.526342:0:5803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:3.0:1787384287.527092:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:3.0:1787384287.527146:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:3.0:1787384287.527228:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:3.0:1787384287.527246:0:5778:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787384287.527248:0:5778:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:3.0:1787384287.527253:0:5778:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787384287.527256:0:5778:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:3.0:1787384287.527262:0:5778:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:3.0:1787384287.527268:0:5778:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1787384287.536616:0:5804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787384287.537715:0:5778:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787384287.552372:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787384287.552429:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787384287.552503:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787384287.552524:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787384287.553232:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.553252:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.553280:0:5778:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.553286:0:5778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.553292:0:5778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.553298:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.553304:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000052ffa207 already unused, calling callback (0000000094720c48) 00010000:00010000:3.0:1787384287.553308:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.553315:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.553326:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.553333:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.553339:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c3070 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787384287.553359:0:5778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1787384287.883920:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002d80bbde pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+5:5763:x1874208195870976:12345-0@lo:253: Request processed in 396439us (396876us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384287.883961:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384287.893938:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006990f3b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195870976:0@lo:253: 10000000:01000000:3.0:1787384287.893961:0:5763:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787384287.893964:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384287.893966:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384287.893967:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384287.893968:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1787384287.893970:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384287.893971:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384287.893972:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384287.893973:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384287.893975:0:5763:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1787384287.893976:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384287.893977:0:5763:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787384287.894004:0:5763:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000017c63a8a from lustre-MDT0000 10000000:01000000:3.0:1787384287.894031:0:5763:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787384287.894034:0:5763:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787384287.894038:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89e351ef8000 10000000:01000000:3.0:1787384287.894042:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384287.894050:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89e351ef8000 from 1 10000000:01000000:3.0:1787384287.894053:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787384287.894091:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.894289:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.894298:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384287.894316:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006990f3b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871104:0@lo:101: 00000100:00100000:3.0:1787384287.894373:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384287.894531:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad97131b going to sleep for 11 seconds 00000100:00100000:2.0:1787384287.894676:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195871104 00000100:00100000:2.0:1787384287.894745:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195871104 00000100:00100000:2.0:1787384287.894804:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384287.894812:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000af919717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+5:5763:x1874208195871104:12345-0@lo:101: 00010000:00010000:2.0:1787384287.894824:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384287.894838:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ce7bb8e6/0x3522fbed3b6c307e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3077 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384287.895011:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce7bb8e6/0x3522fbed3b6c307e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3077 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384287.895021:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ce7bb8e6/0x3522fbed3b6c307e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3077 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384287.895029:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ce7bb8e6, rc 0) 00000100:00100000:2.0:1787384287.896262:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000af919717 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+6:5763:x1874208195871104:12345-0@lo:101: Request processed in 1444us (1882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384287.896275:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384287.900578:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006990f3b3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871104:0@lo:101: 00010000:00010000:0.0:1787384287.900605:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384287.900618:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384287.905042:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ada971de pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871232:0@lo:501: 00000100:00100000:2.0:1787384287.905117:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384287.905180:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ceef3146 going to sleep for 11 seconds 00000100:00100000:3.0:1787384287.905553:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195871232 00000100:00100000:3.0:1787384287.905561:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195871232 00000100:00100000:3.0:1787384287.905629:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384287.905638:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e9ce86c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+6:5763:x1874208195871232:12345-0@lo:501: 00000100:00100000:3.0:1787384287.905934:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e9ce86c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+6:5763:x1874208195871232:12345-0@lo:501: Request processed in 298us (817us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384287.905942:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384287.906582:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ada971de pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871232:0@lo:501: 10000000:01000000:3.0:1787384287.906615:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787384287.906677:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.906697:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384287.906706:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e348611800 10000000:01000000:3.0:1787384287.906714:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787384287.906719:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89e348611800 10000000:01000000:3.0:1787384287.906722:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787384287.906724:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89e348611800 from 1 10000000:01000000:3.0:1787384287.906727:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787384287.906753:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000b7ddc4af/0x3522fbed3b6c3085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.906761:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000b7ddc4af/0x3522fbed3b6c3085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.906768:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000b7ddc4af/0x3522fbed3b6c3085 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384287.906794:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000061259471 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871360:0@lo:101: 00000100:00100000:3.0:1787384287.906828:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384287.906895:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 0000000020f50700 going to sleep for 11 seconds 00000100:00100000:2.0:1787384287.907109:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195871360 00000100:00100000:2.0:1787384287.907121:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195871360 00000100:00100000:2.0:1787384287.907163:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384287.907169:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d0bd4918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+6:5763:x1874208195871360:12345-0@lo:101: 00010000:00010000:2.0:1787384287.907180:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384287.907201:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008d2787bf/0x3522fbed3b6c308c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3085 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384287.907220:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008d2787bf/0x3522fbed3b6c308c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3085 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384287.907228:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008d2787bf/0x3522fbed3b6c308c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3085 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384287.907236:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008d2787bf, rc 0) 00000100:00100000:2.0:1787384287.907276:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d0bd4918 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+7:5763:x1874208195871360:12345-0@lo:101: Request processed in 108us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384287.907283:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384287.907416:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000061259471 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871360:0@lo:101: 00010000:00010000:1.0:1787384287.907428:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000b7ddc4af/0x3522fbed3b6c3085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384287.907436:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000b7ddc4af/0x3522fbed3b6c3085 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384287.907448:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787384287.909048:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000b7ddc4af/0x3522fbed3b6c3085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384287.909068:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000b7ddc4af/0x3522fbed3b6c3085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384287.909076:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787384287.909086:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787384287.909092:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89e348611800 10000000:01000000:1.0:1787384287.909095:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787384287.909098:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787384287.909101:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787384287.909161:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384287.909175:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384287.909189:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384287.909219:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000df64e9ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871488:0@lo:101: 00000100:00100000:1.0:1787384287.909277:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384287.909321:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 000000003168784b going to sleep for 11 seconds 00000100:00100000:3.0:1787384287.909538:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195871488 00000100:00100000:3.0:1787384287.909546:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195871488 00000100:00100000:3.0:1787384287.909582:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384287.909590:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000310a7679 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+7:5763:x1874208195871488:12345-0@lo:101: 00010000:00010000:3.0:1787384287.909600:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384287.909612:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c333c768/0x3522fbed3b6c309a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3093 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.909630:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c333c768/0x3522fbed3b6c309a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3093 expref: 8 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.909638:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c333c768/0x3522fbed3b6c309a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3093 expref: 8 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384287.909645:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c333c768, rc 0) 00000100:00100000:3.0:1787384287.909701:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000310a7679 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+8:5763:x1874208195871488:12345-0@lo:101: Request processed in 112us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384287.909706:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384287.909938:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000df64e9ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871488:0@lo:101: 00010000:00010000:1.0:1787384287.909950:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384287.909958:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384287.910005:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000df64e9ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871616:0@lo:501: 00000100:00100000:1.0:1787384287.910029:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384287.910091:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 000000003168784b going to sleep for 11 seconds 00000100:00100000:3.0:1787384287.910145:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195871616 00000100:00100000:3.0:1787384287.910149:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195871616 00000100:00100000:3.0:1787384287.910263:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384287.910270:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f4e4f67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+8:5763:x1874208195871616:12345-0@lo:501: 00000100:00100000:3.0:1787384287.910630:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f4e4f67 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:5763:x1874208195871616:12345-0@lo:501: Request processed in 360us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384287.910646:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384287.910776:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000df64e9ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871616:0@lo:501: 00000100:00100000:1.0:1787384287.910804:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000df64e9ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871744:0@lo:503: 00000100:00100000:1.0:1787384287.910843:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384287.911002:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 000000003168784b going to sleep for 11 seconds 00000100:00100000:2.0:1787384287.911039:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195871744 00000100:00100000:2.0:1787384287.911043:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195871744 00000100:00100000:2.0:1787384287.911109:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384287.911116:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000036442cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:5763:x1874208195871744:12345-0@lo:503: 00000100:00100000:2.0:1787384287.911302:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000036442cd2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:5763:x1874208195871744:12345-0@lo:503: Request processed in 188us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384287.911309:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384287.911535:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000df64e9ca pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195871744:0@lo:503: 00000100:00100000:0.0:1787384287.913087:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000161df3b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5807:1874208195871872:0@lo:502: 00000100:00100000:0.0:1787384287.913169:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384287.914961:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 0000000081814261 going to sleep for 11 seconds 00000100:00100000:3.0:1787384287.916802:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195871872 00000100:00100000:3.0:1787384287.916815:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195871872 00000100:00100000:3.0:1787384287.916884:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384287.916893:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1fe0e57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:5807:x1874208195871872:12345-0@lo:502: 00000100:00100000:3.0:1787384287.917147:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1fe0e57 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:5807:x1874208195871872:12345-0@lo:502: Request processed in 255us (3978us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384287.917154:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787384287.917522:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000161df3b6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5807:1874208195871872:0@lo:502: 00000020:01000000:0.0:1787384287.917554:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384287.917565:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384287.917568:0:5807:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787384287.917572:0:5807:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787384287.917576:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787384287.917588:0:5807:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000de108092) 00000020:00000080:0.0:1787384287.917610:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787384287.917615:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787384287.917709:0:5807:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787384287.917714:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c30a8 00000020:00000080:0.0:1787384287.917977:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787384287.917980:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384287.917983:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384287.917985:0:5807:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787384287.917987:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384287.917990:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384287.917991:0:5807:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787384287.917994:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787384287.918000:0:5807:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000ebc27cec) 00000020:00000080:0.0:1787384287.918008:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787384287.918011:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787384287.918012:0:5807:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787384287.918014:0:5807:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787384287.918019:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787384287.918052:0:5807:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000017c63a8a from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787384287.918064:0:5807:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008501c91c) 00000020:00000080:0.0:1787384287.918070:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787384287.918133:0:5807:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787384287.918137:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3522fbed3b6c30bd 00000020:00000080:0.0:1787384287.918529:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787384287.918536:0:5807:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787384287.918541:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3522fbed3b6c30c4 00080000:01000000:0.0:1787384287.918545:0:5807:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787384287.918548:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c30cb 00080000:10000000:0.0:1787384287.919298:0:5807:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1787384287.919641:0:5807:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1787384287.929072:0:5807:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787384288.052526:0:5807:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1787384288.055732:0:5807:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1787384288.058035:0:5807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1787384288.058303:0:5807:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1787384288.105176:0:5807:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000008468dac5) 00000020:00000080:3.0:1787384288.105320:0:5807:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1787384288.105478:0:5807:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1787384288.105485:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c30d9 00000020:00000080:3.0:1787384288.120744:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787384288.125512:0:5807:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787384288.177843:0:5807:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787384288.245802:0:5807:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00010000:00010000:2.0:1787384288.266101:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1787384288.285019:0:5807:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1787384288.324156:0:5807:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787384288.366339:0:5807:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:0.0:1787384288.400614:0:5807:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3522fbed3b6c30e0 00000020:00000080:1.0:1787384288.401213:0:5807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787384288.401224:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384288.401231:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384288.401233:0:5807:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787384288.401236:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384288.401239:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384288.401241:0:5807:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787384288.401244:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787384288.401245:0:5807:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787384288.401248:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384288.401250:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384288.401251:0:5807:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787384288.401253:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384288.401257:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384288.401259:0:5807:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787384288.401263:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787384288.401302:0:5807:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1787384288.401353:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000002221a8a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5807:1874208195872000:0@lo:502: 00000100:00100000:1.0:1787384288.401536:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384288.401596:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 00000000482a9a1b going to sleep for 11 seconds 00000100:00100000:3.0:1787384288.401678:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195872000 00000100:00100000:3.0:1787384288.401686:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195872000 00000100:00100000:3.0:1787384288.401739:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787384288.401747:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ae5ecb4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:5807:x1874208195872000:12345-0@lo:502: 00000100:00100000:3.0:1787384288.402092:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ae5ecb4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:5807:x1874208195872000:12345-0@lo:502: Request processed in 345us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384288.402100:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787384288.402158:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000002221a8a4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5807:1874208195872000:0@lo:502: 00000020:01000000:3.0:1787384288.402186:0:5807:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384288.402201:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384288.402203:0:5807:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:3.0:1787384288.402207:0:5807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1787384288.402543:0:5763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1787384288.402561:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787384288.402583:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384288.402595:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384288.402603:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89e348611800 from 1 10000000:01000000:1.0:1787384288.402605:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787384288.402640:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384288.402648:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384288.402656:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384288.402681:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b441d8ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872128:0@lo:101: 00000100:00100000:1.0:1787384288.402717:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384288.402742:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad6b2e02 going to sleep for 11 seconds 00000100:00100000:1.0:1787384288.402762:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195872128 00000100:00100000:1.0:1787384288.402766:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195872128 00000100:00100000:1.0:1787384288.402794:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384288.402801:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006f66dfb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:5763:x1874208195872128:12345-0@lo:101: 00010000:00010000:1.0:1787384288.402811:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384288.402825:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c30ee lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c30e7 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384288.403057:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c30ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c30e7 expref: 10 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384288.403068:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c30ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c30e7 expref: 10 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384288.403076:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f1f3684a, rc 0) 00000100:00100000:1.0:1787384288.403152:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006f66dfb5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:5763:x1874208195872128:12345-0@lo:101: Request processed in 352us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384288.403160:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384288.403538:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b441d8ee pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872128:0@lo:101: 00010000:00010000:0.0:1787384288.403553:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384288.403561:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384288.404456:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000161df3b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872256:0@lo:256: 00000100:00100000:0.0:1787384288.404730:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384288.404770:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cf1a83ad going to sleep for 11 seconds 00000100:00100000:1.0:1787384288.404995:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195872256 00000100:00100000:1.0:1787384288.405003:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195872256 00000100:00100000:1.0:1787384288.405044:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787384288.405052:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000021eec218 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:5763:x1874208195872256:12345-0@lo:256: 20000000:01000000:1.0:1787384288.405069:0:5778:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787384288.405074:0:5778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787384288.405152:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000021eec218 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:5763:x1874208195872256:12345-0@lo:256: Request processed in 102us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384288.405159:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384288.405289:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000161df3b6 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872256:0@lo:256: 10000000:01000000:2.0:1787384288.405835:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787384288.405884:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.405895:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384288.405903:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e348611800 from 1 10000000:01000000:2.0:1787384288.405906:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384288.405936:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.405943:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.405951:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384288.405965:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872384:0@lo:101: 00000100:00100000:2.0:1787384288.406000:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384288.406024:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 0000000025cbfd4a going to sleep for 11 seconds 00000100:00100000:1.0:1787384288.406332:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195872384 00000100:00100000:1.0:1787384288.406338:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195872384 00000100:00100000:1.0:1787384288.406439:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384288.406446:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000048f8bb2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:5763:x1874208195872384:12345-0@lo:101: 00010000:00010000:1.0:1787384288.406455:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384288.406466:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e0d9431/0x3522fbed3b6c30fc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c30f5 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384288.406483:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e0d9431/0x3522fbed3b6c30fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c30f5 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384288.406491:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e0d9431/0x3522fbed3b6c30fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c30f5 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384288.406500:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e0d9431, rc 0) 00000100:00100000:1.0:1787384288.406535:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000048f8bb2b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:5763:x1874208195872384:12345-0@lo:101: Request processed in 90us (535us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384288.406541:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384288.406598:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872384:0@lo:101: 00010000:00010000:2.0:1787384288.406608:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.406615:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384288.406687:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872512:0@lo:501: 00000100:00100000:2.0:1787384288.406713:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384288.407080:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 0000000025cbfd4a going to sleep for 11 seconds 00000100:00100000:3.0:1787384288.407151:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195872512 00000100:00100000:3.0:1787384288.407156:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195872512 00000100:00100000:3.0:1787384288.407184:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384288.407200:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fce07356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:5763:x1874208195872512:12345-0@lo:501: 00000100:00100000:3.0:1787384288.407985:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fce07356 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:5763:x1874208195872512:12345-0@lo:501: Request processed in 794us (1271us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384288.407995:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384288.408184:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872512:0@lo:501: 00000100:00100000:2.0:1787384288.408230:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872640:0@lo:503: 00000100:00100000:2.0:1787384288.408275:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384288.408307:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 0000000025cbfd4a going to sleep for 11 seconds 00000100:00100000:3.0:1787384288.408464:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195872640 00000100:00100000:3.0:1787384288.408469:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195872640 00000100:00100000:3.0:1787384288.408506:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384288.408512:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006ec2e531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:5763:x1874208195872640:12345-0@lo:503: 00000040:00080000:3.0:1787384288.408545:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384288.408587:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006ec2e531 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:5763:x1874208195872640:12345-0@lo:503: Request processed in 75us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384288.408594:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384288.408714:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872640:0@lo:503: 00000040:00080000:2.0:1787384288.409729:0:5811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787384288.409949:0:5763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787384288.409967:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384288.409981:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384288.409992:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384288.410036:0:5763:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787384288.410038:0:5763:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e348611800 10000000:01000000:0.0:1787384288.410041:0:5763:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e348611800 10000000:01000000:0.0:1787384288.410045:0:5763:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787384288.410050:0:5763:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e348611800 from 1 10000000:01000000:0.0:1787384288.410052:0:5763:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787384288.410082:0:5763:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384288.410089:0:5763:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384288.410117:0:5763:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384288.410134:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000c2f46953 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872768:0@lo:101: 00000100:00100000:0.0:1787384288.410179:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384288.410209:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 0000000057bc968d going to sleep for 11 seconds 00000100:00100000:3.0:1787384288.410505:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195872768 00000100:00100000:3.0:1787384288.410512:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195872768 00000100:00100000:3.0:1787384288.410555:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384288.410562:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d8d4ccbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:5763:x1874208195872768:12345-0@lo:101: 00010000:00010000:3.0:1787384288.410572:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384288.410588:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000e8d9aeb/0x3522fbed3b6c310a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3103 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384288.410607:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000e8d9aeb/0x3522fbed3b6c310a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3103 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384288.410615:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000e8d9aeb/0x3522fbed3b6c310a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3103 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384288.410622:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000e8d9aeb, rc 0) 00000100:00100000:3.0:1787384288.410673:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d8d4ccbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5763:x1874208195872768:12345-0@lo:101: Request processed in 112us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384288.410686:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384288.410992:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000c2f46953 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872768:0@lo:101: 00010000:00010000:2.0:1787384288.411005:0:5763:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.411012:0:5763:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384288.411258:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006fa8d0de pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872896:0@lo:501: 00000100:00100000:3.0:1787384288.411286:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384288.411354:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ad97131b going to sleep for 11 seconds 00000100:00100000:0.0:1787384288.411441:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195872896 00000100:00100000:0.0:1787384288.411445:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195872896 00000100:00100000:0.0:1787384288.411501:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787384288.411508:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000693c5223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5763:x1874208195872896:12345-0@lo:501: 00000100:00100000:0.0:1787384288.411762:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000693c5223 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5763:x1874208195872896:12345-0@lo:501: Request processed in 254us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384288.411769:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384288.411836:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006fa8d0de pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195872896:0@lo:501: 00000100:00100000:1.0:1787384288.411906:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004afa3e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195873024:0@lo:503: 00000100:00100000:1.0:1787384288.411952:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384288.412320:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 0000000065654980 going to sleep for 11 seconds 00000100:00100000:3.0:1787384288.412460:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195873024 00000100:00100000:3.0:1787384288.412465:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195873024 00000100:00100000:3.0:1787384288.412492:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384288.412498:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000812fd804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5763:x1874208195873024:12345-0@lo:503: 00000100:00100000:3.0:1787384288.412941:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000812fd804 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5763:x1874208195873024:12345-0@lo:503: Request processed in 442us (987us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384288.412949:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384288.413129:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004afa3e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195873024:0@lo:503: 00000100:00100000:2.0:1787384288.413578:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5812:1874208195873152:0@lo:502: 00000100:00100000:2.0:1787384288.413624:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384288.413686:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 00000000ab489c53 going to sleep for 11 seconds 00000100:00100000:3.0:1787384288.413716:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195873152 00000100:00100000:3.0:1787384288.413720:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195873152 00000100:00100000:3.0:1787384288.413791:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787384288.413798:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006b2055df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5812:x1874208195873152:12345-0@lo:502: 00000100:00100000:3.0:1787384288.414179:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006b2055df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5812:x1874208195873152:12345-0@lo:502: Request processed in 382us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384288.414187:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787384288.414455:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5812:1874208195873152:0@lo:502: 00000020:01000004:2.0:1787384288.414510:0:5812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1787384288.414525:0:5812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000c9fec1e4) 00000020:00000080:2.0:1787384288.414544:0:5812:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1787384288.414723:0:5812:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000017c63a8a from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787384288.414734:0:5812:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000017c63a8a from lustre-MDT0000, refs=4 00000020:01000004:2.0:1787384288.414736:0:5812:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000017c63a8a 4 00010000:00080000:2.0:1787384288.414761:0:5812:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000dba05e4e@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1787384288.419123:0:5812:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787384288.419997:0:5812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787384288.420038:0:5812:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787384288.420052:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3522fbed3b6c3118 00000100:00080000:2.0:1787384288.420062:0:5812:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384288.420067:0:5812:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000dba05e4e using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1787384288.420104:0:5812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000036f9a712 x1874208195873280/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384288.420134:0:5812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787384288.420329:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874208195873280:0@lo:38: 00000100:00100000:0.0:1787384288.420465:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384288.422002:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195873280 00000100:00100000:2.0:1787384288.422015:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195873280 00000100:00100000:2.0:1787384288.422056:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384288.422063:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006e9c83bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874208195873280:12345-0@lo:38: 00000100:00100000:2.0:1787384288.422141:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006e9c83bc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874208195873280:12345-0@lo:38: Request processed in 77us (1675us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787384288.422148:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384288.422267:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384288.422275:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000dba05e4e lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787384288.422279:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787384288.422282:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874208195873280:0@lo:38: 00000100:00100000:2.0:1787384288.423145:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5812:1874208195873408:0@lo:502: 00000100:00100000:2.0:1787384288.423271:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384288.423304:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195873408 00000100:00100000:2.0:1787384288.423309:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195873408 00000100:00100000:2.0:1787384288.423353:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384288.423360:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000290b1312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5812:x1874208195873408:12345-0@lo:502: 00000100:00100000:2.0:1787384288.423631:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000290b1312 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5812:x1874208195873408:12345-0@lo:502: Request processed in 271us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384288.423638:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384288.423698:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set 0000000025cbfd4a going to sleep for 11 seconds 00000100:00100000:2.0:1787384288.423712:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5812:1874208195873408:0@lo:502: 00000040:00080000:2.0:1787384288.423733:0:5812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:1.0:1787384288.426313:0:5763:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787384288.426351:0:5763:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384288.427700:0:5763:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384288.427721:0:5763:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787384288.427784:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787384288.427786:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787384288.427788:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384288.427789:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384288.427790:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384288.427792:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384288.427793:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384288.427794:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787384288.427796:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384288.427797:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384288.427799:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384288.427800:0:5763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384288.427803:0:5763:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787384288.427806:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787384288.427807:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787384288.427808:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384288.427809:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384288.427810:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384288.427811:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384288.427812:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384288.427813:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787384288.427814:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384288.427815:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384288.427816:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384288.427822:0:5763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384288.427874:0:5763:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787384288.427892:0:5763:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004afa3e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195873536:0@lo:253: 00000100:00100000:1.0:1787384288.427959:0:5763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384288.428001:0:5763:0:(client.c:2702:ptlrpc_set_wait()) set 0000000065654980 going to sleep for 11 seconds 00000100:00100000:3.0:1787384288.428608:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195873536 00000100:00100000:3.0:1787384288.428617:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195873536 00000100:00100000:3.0:1787384288.428679:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787384288.428687:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a4b7d71e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5763:x1874208195873536:12345-0@lo:253: 20000000:01000000:3.0:1787384288.428711:0:5777:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1787384288.428725:0:5777:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787384288.457641:0:5777:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787384288.457672:0:5777:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787384288.457727:0:5799:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787384288.457732:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787384288.457756:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.457776:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c30ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c30e7 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.457784:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.457822:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c30ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c30e7 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.457838:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c30ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c30e7 expref: 12 pid: 5776 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384288.457891:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1874208195873664:0@lo:104: 00000100:00100000:2.0:1787384288.457954:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384288.458006:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set 00000000be2a1f04 going to sleep for 11 seconds 00000100:00100000:3.0:1787384288.458325:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195873664 00000100:00100000:3.0:1787384288.458353:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195873664 00000100:00100000:3.0:1787384288.458411:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384288.458420:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002745191f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5799:x1874208195873664:12345-0@lo:104: 00010000:00010000:3.0:1787384288.458430:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384288.458486:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384288.458491:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002745191f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5799:x1874208195873664:12345-0@lo:104: Request processed in 74us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384288.458497:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384288.458701:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1874208195873664:0@lo:104: 00010000:00010000:2.0:1787384288.458725:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.459937:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384288.459947:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.459958:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000072fe00e4 already unused, calling callback (00000000dc1fbff4) 10000000:00010000:2.0:1787384288.459961:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.459969:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384288.459975:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384288.459981:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384288.460018:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460025:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384288.460042:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460048:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c30e7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c30ee expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460066:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384288.460068:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384288.460069:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384288.460146:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195873792:0@lo:103: 00000100:00100000:2.0:1787384288.460488:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384288.460568:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195873792 00000100:00100000:2.0:1787384288.460574:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195873792 00010000:00010000:2.0:1787384288.460592:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c30ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c30e7 expref: 13 pid: 5776 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384288.460617:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384288.460624:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f6416e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:3305:x1874208195873792:12345-0@lo:103: 00010000:00010000:2.0:1787384288.460634:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384288.460637:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c30ee lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c30e7 expref: 13 pid: 5776 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460646:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c30ee lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c30e7 expref: 13 pid: 5776 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460670:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c30ee lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c30e7 expref: 13 pid: 5776 timeout: 299 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460683:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460690:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787384288.460704:0:5768:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002972232s 00010000:00010000:2.0:1787384288.460707:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460713:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460729:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460735:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460741:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003ba1cc76 already unused, calling callback (0000000094720c48) 00010000:00010000:2.0:1787384288.460744:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460750:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460762:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460772:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384288.460803:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f6416e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:3305:x1874208195873792:12345-0@lo:103: Request processed in 179us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384288.460810:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384288.460898:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195873792:0@lo:103: 00010000:00010000:2.0:1787384288.460931:0:5799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460939:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384288.460944:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003ba1cc76/0x3522fbed3b6c311f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384288.468701:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a4b7d71e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:5763:x1874208195873536:12345-0@lo:253: Request processed in 40005us (40732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384288.468717:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384288.468900:0:5763:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004afa3e69 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5763:1874208195873536:0@lo:253: 10000000:01000000:1.0:1787384288.468916:0:5763:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787384288.468919:0:5763:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787384288.468921:0:5763:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787384288.468922:0:5763:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384288.468923:0:5763:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384288.468924:0:5763:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384288.468925:0:5763:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384288.468926:0:5763:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384288.468928:0:5763:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787384288.468929:0:5763:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787384288.468930:0:5763:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787384288.468931:0:5763:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384288.468932:0:5763:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787384288.468947:0:5763:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787384288.477093:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1787384288.478356:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787384288.478673:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1787384288.479074:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787384288.479338:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787384288.479594:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787384288.481151:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787384288.481480:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787384288.481800:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787384288.482166:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1787384288.489606:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787384288.493631:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1787384288.588587:0:5763:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1787384288.657030:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1787384288.657460:0:5817:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787384288.657464:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1787384288.657541:0:5818:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1787384288.672302:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1787384288.676373:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1787384288.676840:0:5763:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1787384288.676854:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1787384288.677055:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384288.685163:0:5763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1787384288.686547:0:5763:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1787384288.686606:0:5763:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1787384288.686888:0:5763:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1787384288.687088:0:5763:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1787384288.688275:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1787384288.688412:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1787384288.688550:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1787384288.693176:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1787384288.693555:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1787384288.693766:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1787384288.694136:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1787384288.694448:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1787384288.694573:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1787384288.694725:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1787384288.695036:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1787384288.695205:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1787384288.695334:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1787384288.695583:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1787384288.695711:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1787384288.696059:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1787384288.696559:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1787384288.696716:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1787384288.697247:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1787384288.697423:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1787384288.697562:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1787384288.697715:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1787384288.697845:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1787384288.698029:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1787384288.698162:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1787384288.698306:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1787384288.698454:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1787384288.698607:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1787384288.698740:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1787384288.698939:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1787384288.699108:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1787384288.699249:0:5763:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1787384288.699424:0:5763:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787384288.720269:0:5818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787384288.799755:0:5763:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787384288.799796:0:5763:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1ec81cc7988 00100000:10000000:2.0:1787384288.799804:0:5763:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1787384288.805928:0:5763:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787384288.805948:0:5763:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787384288.805964:0:5763:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1787384288.806020:0:5763:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:0.0:1787384288.947968:0:5818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1787384288.948056:0:5818:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1787384288.948060:0:5818:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:2.0:1787384289.293482:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384290.324446:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384291.339777:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384292.362935:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384293.387553:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384293.451807:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1787384293.451831:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1787384293.451834:0:36:0:(import.c:65:import_set_state_nolock()) 00000000dba05e4e lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384293.451847:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000dba05e4e using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1787384293.452010:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000fbce8a43 x1874208195874048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384293.452055:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fbce8a43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874208195874048:0@lo:38: 00000100:00100000:0.0:1787384293.452139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384293.452395:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003e64ba3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195873920:0@lo:400: 00000100:00100000:1.0:1787384293.459765:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384293.459851:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195874048 00000100:00100000:1.0:1787384293.459872:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195874048 00000100:00100000:1.0:1787384293.459906:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384293.459912:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000502fe935 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874208195874048:12345-0@lo:38: 00010000:00080000:1.0:1787384293.459941:0:5785:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:1.0:1787384293.460002:0:5785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3522fbed3b6c3126 00000004:00100000:1.0:1787384293.460055:0:5785:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787384293.460636:0:5785:0:(import.c:65:import_set_state_nolock()) 0000000016c15ea4 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384293.460713:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000502fe935 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874208195874048:12345-0@lo:38: Request processed in 800us (8574us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384293.460722:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787384293.460906:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000fbce8a43 x1874208195874048/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384303 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787384293.460922:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787384293.460930:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1787384293.460935:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787384293.460937:0:3303:0:(import.c:65:import_set_state_nolock()) 00000000dba05e4e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787384293.460944:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fbce8a43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874208195874048:0@lo:38: 00000100:00100000:2.0:1787384293.461114:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195873920 00000100:00100000:2.0:1787384293.461121:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195873920 00000100:00100000:2.0:1787384293.461228:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787384293.461236:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c8de713c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:3306:x1874208195873920:12345-0@lo:400: 00000100:00100000:2.0:1787384293.461283:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c8de713c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:3306:x1874208195873920:12345-0@lo:400: Request processed in 49us (1526us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384293.461291:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787384293.461426:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003e64ba3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195873920:0@lo:400: 00000001:02000400:0.0:1787384293.590967:0:6061:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787384294.409053:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384295.436793:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384296.456975:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787384296.521506:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787384296.521515:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89e348611800 from 3 10000000:01000000:2.0:1787384296.521520:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787384296.521567:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 0000000026099e3c/0x3522fbed3b6c312d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384296.521579:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 0000000026099e3c/0x3522fbed3b6c312d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384296.521588:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 0000000026099e3c/0x3522fbed3b6c312d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384296.521621:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195874176:0@lo:101: 00000100:00100000:2.0:1787384296.521690:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384296.521772:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set 000000009a4d1380 going to sleep for 11 seconds 00000100:00100000:0.0:1787384296.522901:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195874176 00000100:00100000:0.0:1787384296.522914:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195874176 00000100:00100000:0.0:1787384296.522975:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384296.522984:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e115ca62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:5780:x1874208195874176:12345-0@lo:101: 00010000:00010000:0.0:1787384296.523000:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384296.523018:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c11674b6/0x3522fbed3b6c3134 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c312d expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384296.523045:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c11674b6/0x3522fbed3b6c3134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c312d expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384296.523067:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c11674b6/0x3522fbed3b6c3134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c312d expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384296.523093:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c11674b6, rc 0) 00000100:00100000:0.0:1787384296.523157:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e115ca62 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5780:x1874208195874176:12345-0@lo:101: Request processed in 174us (1466us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384296.523164:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384296.523321:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000036f9a712 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195874176:0@lo:101: 00010000:00010000:1.0:1787384296.523337:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 0000000026099e3c/0x3522fbed3b6c312d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384296.523358:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 0000000026099e3c/0x3522fbed3b6c312d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384296.523409:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004afa3e69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195874304:0@lo:256: 00000100:00100000:1.0:1787384296.523444:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384296.523476:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set 00000000d69c0124 going to sleep for 11 seconds 00000100:00100000:2.0:1787384296.523593:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195874304 00000100:00100000:2.0:1787384296.523598:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195874304 00000100:00100000:2.0:1787384296.523639:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384296.523645:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f63a39cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5780:x1874208195874304:12345-0@lo:256: 20000000:01000000:2.0:1787384296.523657:0:5778:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787384296.523672:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787384296.523675:0:5778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1787384296.523881:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004afa3e69 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195874304:0@lo:256: 00000100:00100000:2.0:1787384296.523999:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f63a39cd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5780:x1874208195874304:12345-0@lo:256: Request processed in 354us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384296.524007:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 10000000:01000000:3.0:1787384296.525270:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384296.525280:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 0000000026099e3c/0x3522fbed3b6c312d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384296.525291:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 0000000026099e3c/0x3522fbed3b6c312d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384297.483627:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384298.505719:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384298.569160:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000fbce8a43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195874432:0@lo:400: 00000100:00100000:3.0:1787384298.569257:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384298.569403:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9372a41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195874560:0@lo:400: 00000100:00100000:0.0:1787384298.569440:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384298.569514:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195874560 00000100:00100000:0.0:1787384298.569523:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195874560 00000100:00100000:0.0:1787384298.569573:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384298.569583:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004909e718 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195874560:12345-0@lo:400: 00000100:00100000:0.0:1787384298.569654:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004909e718 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195874560:12345-0@lo:400: Request processed in 72us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384298.569661:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787384298.569702:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000d9372a41 x1874208195874560/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384298.569716:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9372a41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195874560:0@lo:400: 00000100:00100000:1.0:1787384298.569933:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195874432 00000100:00100000:1.0:1787384298.569938:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195874432 00000100:00100000:1.0:1787384298.569980:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384298.569986:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f9d11e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:3307:x1874208195874432:12345-0@lo:400: 00000100:00100000:1.0:1787384298.570195:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f9d11e4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:3307:x1874208195874432:12345-0@lo:400: Request processed in 208us (937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384298.570202:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787384298.571055:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000fbce8a43 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195874432:0@lo:400: 00000020:00000080:3.0:1787384298.737520:0:6262:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc233e8980 00000020:00000080:3.0:1787384298.737550:0:6262:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787384298.737556:0:6262:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787384298.737565:0:6262:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc233eac10 20000000:00000080:3.0:1787384298.737572:0:6262:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e3741f7800 uarg=0000000000000000 20000000:01000000:3.0:1787384298.737631:0:6262:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787384298.737640:0:6262:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787384298.737646:0:6262:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1787384298.739710:0:6262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1787384298.739728:0:6262:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1787384298.747021:0:6262:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384298.747471:0:6262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787384298.747530:0:6262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1787384298.747580:0:6262:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1787384298.747614:0:6262:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787384298.747634:0:6262:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.747651:0:6262:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e0d9431/0x3522fbed3b6c30fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c30f5 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.747658:0:6262:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.747693:0:6262:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e0d9431/0x3522fbed3b6c30fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c30f5 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.747708:0:6262:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e0d9431/0x3522fbed3b6c30fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c30f5 expref: 11 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384298.747721:0:6262:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9bde494 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6262:1874208195874688:0@lo:104: 00000100:00100000:3.0:1787384298.747779:0:6262:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384298.747979:0:6262:0:(client.c:2702:ptlrpc_set_wait()) set 00000000416fb7dc going to sleep for 11 seconds 00000100:00100000:1.0:1787384298.748527:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195874688 00000100:00100000:1.0:1787384298.748536:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195874688 00000100:00100000:1.0:1787384298.748603:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384298.748612:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c8dada5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:6262:x1874208195874688:12345-0@lo:104: 00010000:00010000:1.0:1787384298.748624:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384298.748694:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384298.748699:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c8dada5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:6262:x1874208195874688:12345-0@lo:104: Request processed in 90us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384298.748706:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1787384298.748737:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384298.748749:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384298.748784:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008d208af4 already unused, calling callback (00000000dc1fbff4) 10000000:00010000:2.0:1787384298.748789:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384298.748799:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384298.748806:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384298.748812:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1787384298.748905:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384298.748912:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384298.748934:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384298.748941:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 000000008d208af4/0x3522fbed3b6c30f5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c30fc expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384298.748966:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384298.748968:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384298.748969:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384298.749107:0:6262:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9bde494 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6262:1874208195874688:0@lo:104: 00000100:00100000:0.0:1787384298.749113:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000098d66df2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195874816:0@lo:103: 00010000:00010000:3.0:1787384298.749149:0:6262:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384298.749188:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384298.749376:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195874816 00000100:00100000:3.0:1787384298.749383:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195874816 00010000:00010000:3.0:1787384298.749404:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e0d9431/0x3522fbed3b6c30fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c30f5 expref: 12 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384298.749437:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384298.749443:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d9372a41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:3305:x1874208195874816:12345-0@lo:103: 00010000:00010000:3.0:1787384298.749454:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384298.749459:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e0d9431/0x3522fbed3b6c30fc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c30f5 expref: 12 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749469:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e0d9431/0x3522fbed3b6c30fc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c30f5 expref: 12 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749484:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e0d9431/0x3522fbed3b6c30fc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c30f5 expref: 12 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749497:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749504:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749515:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749522:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749539:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749545:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749550:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000bc98f052 already unused, calling callback (0000000094720c48) 00010000:00010000:3.0:1787384298.749553:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749560:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749579:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384298.749598:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384298.749627:0:6262:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384298.749652:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d9372a41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:3305:x1874208195874816:12345-0@lo:103: Request processed in 206us (462us total) trans 0 rc 0/0 00010000:00010000:1.0:1787384298.749662:0:6262:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384298.749669:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1787384298.749682:0:6262:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000bc98f052/0x3522fbed3b6c313b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6262 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384298.750792:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000098d66df2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195874816:0@lo:103: 00010000:00010000:0.0:1787384299.528998:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384300.553623:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384301.577084:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384302.606256:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384303.625065:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384303.689190:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000007cb6b7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195875072:0@lo:400: 00000100:00100000:3.0:1787384303.689263:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384303.689330:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384303.689336:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000d9bde494 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195874944:0@lo:400: 00000100:00100000:3.0:1787384303.689366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384303.689945:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195874944 00000100:00100000:0.0:1787384303.689961:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195874944 00000100:00100000:0.0:1787384303.690004:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787384303.690011:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000771e29c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:3307:x1874208195874944:12345-0@lo:400: 00000100:00100000:0.0:1787384303.690066:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000771e29c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:3307:x1874208195874944:12345-0@lo:400: Request processed in 55us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384303.690074:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787384303.690137:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000d9bde494 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195874944:0@lo:400: 00000100:00100000:1.0:1787384303.690276:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195875072 00000100:00100000:1.0:1787384303.690281:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195875072 00000100:00100000:1.0:1787384303.690313:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384303.690319:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002fb22c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195875072:12345-0@lo:400: 00000100:00100000:1.0:1787384303.690360:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002fb22c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195875072:12345-0@lo:400: Request processed in 41us (1098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384303.690366:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787384303.690521:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000007cb6b7f x1874208195875072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384319 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384303.690543:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000007cb6b7f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195875072:0@lo:400: 00000020:01000004:2.0:1787384304.024255:0:6571:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787384304.024258:0:6571:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787384304.024603:0:6571:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000f33c4112 00000020:01000004:2.0:1787384304.024619:0:6571:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1787384304.024635:0:6571:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787384304.024648:0:6571:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000d5a9f671) 00000020:00000080:2.0:1787384304.024661:0:6571:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787384304.042946:0:6571:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:1.0:1787384304.043399:0:6571:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:0.0:1787384304.068023:0:6571:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:0.0:1787384304.074759:0:6571:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787384304.074786:0:6571:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:0.0:1787384304.074829:0:6571:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787384304.074949:0:6571:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:0.0:1787384304.075627:0:6571:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787384304.075638:0:6571:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787384304.075649:0:6571:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3522fbed3b6c3149 00000020:01000004:0.0:1787384304.075657:0:6571:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787384304.075678:0:6571:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787384304.075681:0:6571:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787384304.075686:0:6571:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787384304.075690:0:6571:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787384304.075710:0:6571:0:(genops.c:413:class_newdev()) Allocate new device OSS (00000000b0e039f0) 00000020:00000080:0.0:1787384304.075723:0:6571:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:0.0:1787384304.078766:0:6571:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384304.080475:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787384304.080648:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1787384304.083911:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1787384304.083924:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787384304.086013:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787384304.086036:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787384304.089287:0:6571:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384304.089496:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787384304.089502:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787384304.091803:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787384304.091817:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1787384304.114459:0:6571:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384304.114706:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787384304.114713:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787384304.121149:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787384304.121168:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787384304.122199:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787384304.122208:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787384304.125950:0:6571:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384304.126138:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787384304.126144:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787384304.128393:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787384304.128407:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1787384304.183355:0:6571:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384304.183560:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1787384304.183567:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1787384304.184761:0:6571:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1787384304.184773:0:6571:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1787384304.185411:0:6571:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1787384304.185435:0:6571:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1787384304.185441:0:6571:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1787384304.210145:0:6571:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787384304.210186:0:6571:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.151@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1787384304.210190:0:6571:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787384304.210192:0:6571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787384304.210193:0:6571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384304.210194:0:6571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384304.210195:0:6571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384304.210197:0:6571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384304.210198:0:6571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384304.210199:0:6571:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384304.210201:0:6571:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384304.210202:0:6571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384304.210203:0:6571:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384304.210207:0:6571:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1787384304.210209:0:6571:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384304.210211:0:6571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787384304.210212:0:6571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384304.210213:0:6571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384304.210214:0:6571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384304.210215:0:6571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384304.210216:0:6571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384304.210217:0:6571:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384304.210218:0:6571:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384304.210219:0:6571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384304.210220:0:6571:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384304.210254:0:6571:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787384304.210271:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000b6d860ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195875200:0@lo:253: 00000100:00100000:3.0:1787384304.210418:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384304.210519:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b36e858e going to sleep for 11 seconds 00000100:00100000:1.0:1787384304.210619:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195875200 00000100:00100000:1.0:1787384304.210628:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195875200 00000100:00100000:1.0:1787384304.210719:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384304.210728:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001265d214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195875200:12345-0@lo:253: 20000000:01000000:1.0:1787384304.210766:0:5777:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787384304.210770:0:5777:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:1.0:1787384304.210774:0:5777:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:1.0:1787384304.210778:0:5777:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:1.0:1787384304.211993:0:5777:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384304.212278:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1787384304.212650:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:1.0:1787384304.212704:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:1.0:1787384304.212713:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:1.0:1787384304.213163:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:1.0:1787384304.213259:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:1.0:1787384304.213762:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:1.0:1787384304.213783:0:5777:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.151@tcp 20000000:01000000:1.0:1787384304.213785:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787384304.213822:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:1.0:1787384304.213830:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787384304.214424:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:1.0:1787384304.214436:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:1.0:1787384304.214477:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:1.0:1787384304.214487:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787384304.214518:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:1.0:1787384304.214624:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:1.0:1787384304.215576:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:1.0:1787384304.215600:0:5777:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.151@tcp 20000000:01000000:1.0:1787384304.215601:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787384304.215651:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:1.0:1787384304.215660:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787384304.215691:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:1.0:1787384304.215699:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:1.0:1787384304.215748:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:1.0:1787384304.215758:0:5777:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:1.0:1787384304.215788:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:1.0:1787384304.215819:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:1.0:1787384304.215834:0:5777:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787384304.215836:0:5777:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787384304.215840:0:5777:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787384304.216003:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787384304.216006:0:5777:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787384304.216113:0:5777:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787384304.216116:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787384304.216783:0:6586:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:1.0:1787384304.217233:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:1.0:1787384304.217277:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:1.0:1787384304.217417:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:1.0:1787384304.217431:0:5777:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787384304.217434:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787384304.217833:0:6587:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1787384304.218235:0:6587:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1787384304.218376:0:6587:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:1.0:1787384304.218655:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:1.0:1787384304.218691:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:1.0:1787384304.218742:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:1.0:1787384304.218754:0:5777:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787384304.218756:0:5777:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787384304.219376:0:6588:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1787384304.219428:0:6588:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1787384304.219478:0:6588:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:1.0:1787384304.219736:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:1.0:1787384304.219771:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:1.0:1787384304.219802:0:5777:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:1.0:1787384304.219813:0:5777:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1787384304.219816:0:5777:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1787384304.219825:0:5777:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787384304.219844:0:5777:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.219950:0:5777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ce7bb8e6/0x3522fbed3b6c307e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3077 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.219958:0:5777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c333c768/0x3522fbed3b6c309a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3093 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.219963:0:5777:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000e8d9aeb/0x3522fbed3b6c310a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3103 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.219969:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.220010:0:5777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000e8d9aeb/0x3522fbed3b6c310a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c3103 expref: 11 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.220096:0:5777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000e8d9aeb/0x3522fbed3b6c310a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c3103 expref: 11 pid: 5778 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384304.220112:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000158e9ada pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5777:1874208195875328:0@lo:104: 00000100:00100000:1.0:1787384304.220177:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384304.220283:0:5777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c333c768/0x3522fbed3b6c309a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c3093 expref: 11 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.220300:0:5777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c333c768/0x3522fbed3b6c309a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c3093 expref: 11 pid: 5776 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384304.220308:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e61d9f17 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5777:1874208195875456:0@lo:104: 00000100:00100000:1.0:1787384304.220329:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384304.220516:0:5777:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ce7bb8e6/0x3522fbed3b6c307e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c3077 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.220525:0:5777:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ce7bb8e6/0x3522fbed3b6c307e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c3077 expref: 11 pid: 5777 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384304.220533:0:5777:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007313bf03 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5777:1874208195875584:0@lo:104: 00000100:00100000:1.0:1787384304.220576:0:5777:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384304.220597:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195875328 00000100:00100000:0.0:1787384304.220605:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195875328 00000100:00100000:2.0:1787384304.220662:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195875456 00000100:00100000:2.0:1787384304.220667:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195875456 00000100:00100000:2.0:1787384304.220688:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384304.220705:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069c334cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+4:5777:x1874208195875328:12345-0@lo:104: 00010000:00010000:2.0:1787384304.220717:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.220783:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384304.220788:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069c334cb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+4:5777:x1874208195875328:12345-0@lo:104: Request processed in 95us (612us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384304.220795:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384304.220814:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384304.220820:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ac2dc36 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5777:x1874208195875456:12345-0@lo:104: 00010000:00010000:2.0:1787384304.220827:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.220889:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787384304.220894:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ac2dc36 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5777:x1874208195875456:12345-0@lo:104: Request processed in 75us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384304.220899:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1787384304.221269:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384304.221275:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221283:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000362b5774 already unused, calling callback (00000000dc1fbff4) 10000000:00010000:3.0:1787384304.221363:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221372:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384304.221378:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384304.221383:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384304.221421:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221427:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384304.221444:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221450:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 00000000362b5774/0x3522fbed3b6c3103 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c310a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221465:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384304.221468:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221473:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000003e2441e0 already unused, calling callback (00000000dc1fbff4) 10000000:00010000:3.0:1787384304.221475:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221480:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384304.221496:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384304.221501:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384304.221527:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221534:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384304.221538:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221544:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 000000003e2441e0/0x3522fbed3b6c3093 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c309a expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221563:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384304.221565:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384304.221566:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384304.221663:0:5777:0:(client.c:2702:ptlrpc_set_wait()) set 00000000851a254f going to sleep for 11 seconds 00000100:00100000:1.0:1787384304.221687:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000158e9ada pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5777:1874208195875328:0@lo:104: 00000100:00100000:1.0:1787384304.221696:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e61d9f17 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5777:1874208195875456:0@lo:104: 00000100:00100000:3.0:1787384304.221756:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195875584 00000100:00100000:3.0:1787384304.221761:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195875584 00000100:00100000:3.0:1787384304.221788:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384304.221794:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001479ebcb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5777:x1874208195875584:12345-0@lo:104: 00010000:00010000:3.0:1787384304.221801:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221852:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384304.221857:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001479ebcb pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5777:x1874208195875584:12345-0@lo:104: Request processed in 64us (1282us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384304.221884:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1787384304.221900:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384304.221909:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221915:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000052ffa207 already unused, calling callback (00000000dc1fbff4) 10000000:00010000:3.0:1787384304.221917:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221922:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384304.221927:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384304.221931:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384304.221948:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221954:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384304.221966:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221972:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 0000000052ffa207/0x3522fbed3b6c3077 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c307e expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.221988:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384304.221989:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384304.221990:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384304.222145:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384304.222164:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000008cfb6e45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195875968:0@lo:103: 00000100:00100000:1.0:1787384304.222199:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.222240:0:5777:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007313bf03 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5777:1874208195875584:0@lo:104: 00010000:00010000:1.0:1787384304.222262:0:5777:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384304.222429:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195875968 00000100:00100000:3.0:1787384304.222434:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195875968 00010000:00010000:3.0:1787384304.222454:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ce7bb8e6/0x3522fbed3b6c307e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3077 expref: 12 pid: 5777 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384304.222521:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384304.222528:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000038de0486 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:3307:x1874208195875968:12345-0@lo:103: 00010000:00010000:3.0:1787384304.222538:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384304.222543:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ce7bb8e6/0x3522fbed3b6c307e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3077 expref: 12 pid: 5777 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.222561:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ce7bb8e6/0x3522fbed3b6c307e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c3077 expref: 12 pid: 5777 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.222574:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce7bb8e6/0x3522fbed3b6c307e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c3077 expref: 12 pid: 5777 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.222587:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384304.222616:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000038de0486 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:3307:x1874208195875968:12345-0@lo:103: Request processed in 90us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384304.222622:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384304.222674:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000008cfb6e45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195875968:0@lo:103: 00010000:00010000:0.0:1787384304.222764:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384304.222774:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000cc2a553f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195875712:0@lo:103: 00000100:00100000:0.0:1787384304.222800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.223043:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000062cd19a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195875840:0@lo:103: 00000100:00100000:0.0:1787384304.224091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.224237:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195875712 00000100:00100000:2.0:1787384304.224244:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195875712 00010000:00010000:2.0:1787384304.224274:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000e8d9aeb/0x3522fbed3b6c310a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3103 expref: 11 pid: 5778 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384304.224307:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384304.224315:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000032b515a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:3304:x1874208195875712:12345-0@lo:103: 00010000:00010000:2.0:1787384304.224325:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384304.224329:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000e8d9aeb/0x3522fbed3b6c310a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3103 expref: 11 pid: 5778 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.224339:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000e8d9aeb/0x3522fbed3b6c310a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c3103 expref: 11 pid: 5778 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.224353:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000e8d9aeb/0x3522fbed3b6c310a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c3103 expref: 11 pid: 5778 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.224382:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384304.224424:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000032b515a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:3304:x1874208195875712:12345-0@lo:103: Request processed in 111us (1623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384304.224431:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384304.224468:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000cc2a553f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195875712:0@lo:103: 00000100:00100000:2.0:1787384304.224981:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195875840 00000100:00100000:2.0:1787384304.224988:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195875840 00010000:00010000:2.0:1787384304.225004:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c333c768/0x3522fbed3b6c309a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3093 expref: 10 pid: 5776 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384304.225141:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384304.225148:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d5989331 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:3305:x1874208195875840:12345-0@lo:103: 00010000:00010000:2.0:1787384304.225158:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384304.225161:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c333c768/0x3522fbed3b6c309a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3093 expref: 10 pid: 5776 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225171:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c333c768/0x3522fbed3b6c309a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c3093 expref: 10 pid: 5776 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225181:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c333c768/0x3522fbed3b6c309a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c3093 expref: 10 pid: 5776 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225191:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225198:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225212:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225228:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225233:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225238:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225244:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e08ce3f0 already unused, calling callback (0000000094720c48) 00010000:00010000:2.0:1787384304.225247:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225253:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225275:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.225286:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384304.225331:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d5989331 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:3305:x1874208195875840:12345-0@lo:103: Request processed in 184us (1244us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384304.225337:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1787384304.225387:0:5777:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.225395:0:5777:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.225401:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000e08ce3f0/0x3522fbed3b6c3157 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787384304.225414:0:5777:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787384304.226299:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000062cd19a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195875840:0@lo:103: 00000100:00100000:3.0:1787384304.266846:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001265d214 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+8:6571:x1874208195875200:12345-0@lo:253: Request processed in 56111us (56421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384304.266891:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787384304.267003:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000b6d860ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195875200:0@lo:253: 10000000:01000000:2.0:1787384304.267030:0:6571:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1787384304.267034:0:6571:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787384304.267036:0:6571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1787384304.267037:0:6571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384304.267053:0:6571:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1787384304.267055:0:6571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384304.267056:0:6571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384304.267058:0:6571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787384304.267059:0:6571:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1787384304.267061:0:6571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384304.267062:0:6571:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1787384304.267089:0:6571:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000f33c4112 from lustre-OST0000 10000000:01000000:2.0:1787384304.267112:0:6571:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1787384304.267115:0:6571:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787384304.267122:0:6571:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e351ef8000 local copy 10000000:01000000:2.0:1787384304.267126:0:6571:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787384304.267160:0:6571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.267181:0:6571:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.267189:0:6571:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384304.267206:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876096:0@lo:101: 00000100:00100000:2.0:1787384304.267242:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.267292:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000001a3391d5 going to sleep for 11 seconds 00000100:00100000:0.0:1787384304.267614:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195876096 00000100:00100000:0.0:1787384304.267622:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195876096 00000100:00100000:0.0:1787384304.267666:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384304.267674:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000887fb2bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+8:6571:x1874208195876096:12345-0@lo:101: 00010000:00010000:0.0:1787384304.267686:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384304.267699:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000054bcd6/0x3522fbed3b6c3165 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c315e expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.267721:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000054bcd6/0x3522fbed3b6c3165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c315e expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.267743:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000054bcd6/0x3522fbed3b6c3165 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c315e expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.267752:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000054bcd6, rc 0) 00000100:00100000:0.0:1787384304.267793:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000887fb2bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:6571:x1874208195876096:12345-0@lo:101: Request processed in 119us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384304.267800:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787384304.268204:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876096:0@lo:101: 00010000:00010000:2.0:1787384304.268218:0:6571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.268226:0:6571:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384304.268324:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876224:0@lo:501: 00000100:00100000:2.0:1787384304.268363:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.268393:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000001a3391d5 going to sleep for 11 seconds 00000100:00100000:3.0:1787384304.268511:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195876224 00000100:00100000:3.0:1787384304.268516:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195876224 00000100:00100000:3.0:1787384304.268562:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384304.268569:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000028fb6bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:6571:x1874208195876224:12345-0@lo:501: 00000100:00100000:3.0:1787384304.268772:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000028fb6bc6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:6571:x1874208195876224:12345-0@lo:501: Request processed in 204us (408us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384304.268780:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787384304.269494:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876224:0@lo:501: 10000000:01000000:2.0:1787384304.269512:0:6571:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787384304.269546:0:6571:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787384304.269560:0:6571:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.269569:0:6571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.269575:0:6571:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.269596:0:6571:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787384304.269614:0:6571:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e3450ec800 10000000:01000000:2.0:1787384304.269620:0:6571:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787384304.269624:0:6571:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89e351ef8000 10000000:01000000:2.0:1787384304.269627:0:6571:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787384304.269630:0:6571:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff89e351ef8000 from 1 10000000:01000000:2.0:1787384304.269632:0:6571:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787384304.269655:0:6571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 00000000bcfd3fa5/0x3522fbed3b6c316c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.269662:0:6571:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 00000000bcfd3fa5/0x3522fbed3b6c316c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.269669:0:6571:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 00000000bcfd3fa5/0x3522fbed3b6c316c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384304.269695:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876352:0@lo:101: 00000100:00100000:2.0:1787384304.269729:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.269808:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dfbdfd9 going to sleep for 11 seconds 00010000:00010000:3.0:1787384304.269891:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384304.269905:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.269912:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e95f2ddd already unused, calling callback (00000000dc1fbff4) 10000000:00010000:3.0:1787384304.269914:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.269921:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384304.269927:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384304.269932:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384304.269949:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.269955:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384304.269979:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.269985:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: 00000000e95f2ddd/0x3522fbed3b6c315e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x3522fbed3b6c3165 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.270001:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384304.270002:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384304.270004:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384304.270050:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084e47c90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195876480:0@lo:103: 00000100:00100000:2.0:1787384304.270089:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384304.270158:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195876480 00000100:00100000:3.0:1787384304.270172:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195876480 00000100:00100000:3.0:1787384304.270217:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384304.270223:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ca9a87e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:3307:x1874208195876480:12345-0@lo:103: 00010000:00010000:3.0:1787384304.270241:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384304.270253:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000054bcd6/0x3522fbed3b6c3165 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c315e expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.270265:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384304.270291:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ca9a87e5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+8:3307:x1874208195876480:12345-0@lo:103: Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384304.270298:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384304.270421:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084e47c90 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195876480:0@lo:103: 00000100:00100000:1.0:1787384304.270985:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195876352 00000100:00100000:1.0:1787384304.270992:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195876352 00000100:00100000:1.0:1787384304.271038:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384304.271046:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c9af428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+8:6571:x1874208195876352:12345-0@lo:101: 00010000:00010000:1.0:1787384304.271058:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384304.271070:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000097a78e3b/0x3522fbed3b6c3173 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c316c expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.271100:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000097a78e3b/0x3522fbed3b6c3173 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c316c expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.271110:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000097a78e3b/0x3522fbed3b6c3173 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c316c expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.271117:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000097a78e3b, rc 0) 00000100:00100000:1.0:1787384304.271404:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c9af428 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:6571:x1874208195876352:12345-0@lo:101: Request processed in 359us (1674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384304.271411:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787384304.271685:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876352:0@lo:101: 00010000:00010000:2.0:1787384304.271699:0:6571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 00000000bcfd3fa5/0x3522fbed3b6c316c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3173 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.271708:0:6571:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 00000000bcfd3fa5/0x3522fbed3b6c316c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3173 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384304.271727:0:6571:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787384304.271780:0:6571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 00000000bcfd3fa5/0x3522fbed3b6c316c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3173 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.271788:0:6571:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 00000000bcfd3fa5/0x3522fbed3b6c316c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3173 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384304.271795:0:6571:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787384304.271800:0:6571:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384304.271806:0:6571:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787384304.271808:0:6571:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787384304.271827:0:6571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 000000003ba1cc76/0x3522fbed3b6c317a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.271849:0:6571:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 000000003ba1cc76/0x3522fbed3b6c317a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.271856:0:6571:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 000000003ba1cc76/0x3522fbed3b6c317a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384304.271896:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876608:0@lo:101: 00000100:00100000:2.0:1787384304.271933:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.271965:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dfbdfd9 going to sleep for 11 seconds 00000100:00100000:1.0:1787384304.272044:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195876608 00000100:00100000:1.0:1787384304.272050:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195876608 00000100:00100000:1.0:1787384304.272099:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384304.272106:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f675b26c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:6571:x1874208195876608:12345-0@lo:101: 00010000:00010000:1.0:1787384304.272114:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384304.272123:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c3181 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c317a expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.272137:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c3181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c317a expref: 10 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.272144:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f1f3684a/0x3522fbed3b6c3181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c317a expref: 10 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.272152:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f1f3684a, rc 0) 00000100:00100000:1.0:1787384304.272192:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f675b26c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:6571:x1874208195876608:12345-0@lo:101: Request processed in 87us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384304.272198:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384304.272443:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876608:0@lo:101: 00010000:00010000:2.0:1787384304.272454:0:6571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 000000003ba1cc76/0x3522fbed3b6c317a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.272462:0:6571:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 000000003ba1cc76/0x3522fbed3b6c317a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384304.272561:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876736:0@lo:501: 00000100:00100000:2.0:1787384304.272607:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.272635:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dfbdfd9 going to sleep for 11 seconds 00000100:00100000:0.0:1787384304.272698:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195876736 00000100:00100000:0.0:1787384304.272703:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195876736 00000100:00100000:0.0:1787384304.272736:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787384304.272742:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000be44ab63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:6571:x1874208195876736:12345-0@lo:501: 00000100:00100000:0.0:1787384304.273005:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000be44ab63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:6571:x1874208195876736:12345-0@lo:501: Request processed in 262us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384304.273023:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787384304.273417:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876736:0@lo:501: 00000100:00100000:2.0:1787384304.273450:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876864:0@lo:503: 00000100:00100000:2.0:1787384304.273493:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.273522:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dfbdfd9 going to sleep for 11 seconds 00000100:00100000:1.0:1787384304.273595:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195876864 00000100:00100000:1.0:1787384304.273600:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195876864 00000100:00100000:1.0:1787384304.273634:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384304.273641:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cbfca363 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:6571:x1874208195876864:12345-0@lo:503: 00000100:00100000:1.0:1787384304.273794:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cbfca363 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:6571:x1874208195876864:12345-0@lo:503: Request processed in 153us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384304.273801:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384304.273912:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876864:0@lo:503: 00000040:00080000:2.0:1787384304.274318:0:6571:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384304.274378:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876992:0@lo:502: 00000100:00100000:2.0:1787384304.274419:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.274431:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dfbdfd9 going to sleep for 11 seconds 00000100:00100000:1.0:1787384304.274576:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195876992 00000100:00100000:1.0:1787384304.274581:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195876992 00000100:00100000:1.0:1787384304.274616:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787384304.274622:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008600c61c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:6571:x1874208195876992:12345-0@lo:502: 00000100:00100000:1.0:1787384304.274759:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008600c61c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:6571:x1874208195876992:12345-0@lo:502: Request processed in 137us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384304.274785:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787384304.275056:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195876992:0@lo:502: 00000040:00080000:2.0:1787384304.275489:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787384304.275545:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787384304.275593:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787384304.275644:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787384304.275679:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787384304.275707:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787384304.275733:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877120:0@lo:502: 00000100:00100000:2.0:1787384304.275778:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.275804:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000001dfbdfd9 going to sleep for 11 seconds 00000100:00100000:1.0:1787384304.275889:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195877120 00000100:00100000:1.0:1787384304.275895:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195877120 00000100:00100000:1.0:1787384304.275929:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384304.275936:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1de3458 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:6571:x1874208195877120:12345-0@lo:502: 00000100:00100000:1.0:1787384304.276112:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1de3458 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:6571:x1874208195877120:12345-0@lo:502: Request processed in 176us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384304.276119:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787384304.276548:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000096f33a21 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877120:0@lo:502: 00000040:00080000:2.0:1787384304.276664:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787384304.276676:0:6571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:1.0:1787384304.277675:0:6591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787384304.277685:0:6591:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1787384304.277692:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384304.277694:0:6591:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1787384304.277699:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384304.277714:0:6591:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (00000000df3c7f47) 00000020:00000080:1.0:1787384304.277735:0:6591:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:1.0:1787384304.277742:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1787384304.277819:0:6591:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000f33c4112 from lustre-OST0000, refs=2 00080000:01000000:1.0:1787384304.277827:0:6591:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:1.0:1787384304.277834:0:6591:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3522fbed3b6c318f 00010000:00010000:1.0:1787384304.283393:0:6591:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:1.0:1787384304.283673:0:6591:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:1.0:1787384304.286809:0:6591:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:1.0:1787384304.287498:0:6591:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787384304.292717:0:6591:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787384304.293909:0:6591:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787384304.295675:0:6591:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787384304.295687:0:6591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384304.295693:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384304.295696:0:6591:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787384304.295699:0:6591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384304.295703:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384304.295704:0:6591:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787384304.295707:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787384304.295708:0:6591:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787384304.295764:0:6591:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384304.295767:0:6591:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384304.295769:0:6591:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787384304.295771:0:6591:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787384304.295964:0:6571:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1787384304.295990:0:6571:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787384304.296008:0:6571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: 000000003ba1cc76/0x3522fbed3b6c317a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.296030:0:6571:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: 000000003ba1cc76/0x3522fbed3b6c317a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384304.296049:0:6571:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e3450ec800 from 1 10000000:01000000:1.0:1787384304.296051:0:6571:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787384304.296096:0:6571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c3196 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.296104:0:6571:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c3196 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.296114:0:6571:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c3196 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384304.296136:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007313bf03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877248:0@lo:101: 00000100:00100000:1.0:1787384304.296206:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.296260:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000006633870b going to sleep for 11 seconds 00000100:00100000:3.0:1787384304.298321:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195877248 00000100:00100000:3.0:1787384304.298335:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195877248 00000100:00100000:3.0:1787384304.298386:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787384304.298395:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000067f5a7b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+10:6571:x1874208195877248:12345-0@lo:101: 00010000:00010000:3.0:1787384304.298412:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384304.298427:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c319d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3196 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.298466:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c319d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3196 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.298476:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000052ffa207/0x3522fbed3b6c319d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3196 expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.298486:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000052ffa207, rc 0) 00000100:00100000:3.0:1787384304.298565:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000067f5a7b9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195877248:12345-0@lo:101: Request processed in 171us (2359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384304.298572:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384304.298773:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007313bf03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877248:0@lo:101: 00010000:00010000:1.0:1787384304.298790:0:6571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c3196 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.298799:0:6571:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: 0000000072fe00e4/0x3522fbed3b6c3196 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384304.298945:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007313bf03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877376:0@lo:501: 00000100:00100000:1.0:1787384304.298978:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.299006:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000006633870b going to sleep for 11 seconds 00000100:00100000:0.0:1787384304.300466:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195877376 00000100:00100000:0.0:1787384304.300476:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195877376 00000100:00100000:0.0:1787384304.300526:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787384304.300534:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003d8e06d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195877376:12345-0@lo:501: 00000100:00100000:0.0:1787384304.300794:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003d8e06d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195877376:12345-0@lo:501: Request processed in 260us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384304.300802:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787384304.301165:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007313bf03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877376:0@lo:501: 00000100:00100000:1.0:1787384304.301208:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007313bf03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877504:0@lo:503: 00000100:00100000:1.0:1787384304.301263:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.301383:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 000000006633870b going to sleep for 11 seconds 00000100:00100000:2.0:1787384304.306394:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195877504 00000100:00100000:2.0:1787384304.306412:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195877504 00000100:00100000:2.0:1787384304.306472:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787384304.306482:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000023b29e5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195877504:12345-0@lo:503: 00000100:00100000:2.0:1787384304.306834:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000023b29e5d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195877504:12345-0@lo:503: Request processed in 353us (5570us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384304.306842:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787384304.307028:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007313bf03 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877504:0@lo:503: 00000040:00080000:3.0:1787384304.307336:0:6571:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384304.307405:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f37bdf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877632:0@lo:502: 00000100:00100000:3.0:1787384304.307453:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384304.307489:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e95a6952 going to sleep for 11 seconds 00000100:00100000:2.0:1787384304.308320:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195877632 00000100:00100000:2.0:1787384304.308329:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195877632 00000100:00100000:2.0:1787384304.308369:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384304.308377:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000db03326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195877632:12345-0@lo:502: 00000100:00100000:2.0:1787384304.308589:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000db03326 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195877632:12345-0@lo:502: Request processed in 213us (1136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384304.308603:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787384304.308802:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f37bdf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877632:0@lo:502: 00000040:00080000:3.0:1787384304.309112:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787384304.309164:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787384304.309193:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000f37bdf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877760:0@lo:502: 00000100:00100000:3.0:1787384304.309234:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384304.309262:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e95a6952 going to sleep for 11 seconds 00000100:00100000:1.0:1787384304.309432:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195877760 00000100:00100000:1.0:1787384304.309438:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195877760 00000100:00100000:1.0:1787384304.309473:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384304.309480:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000afe7c498 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195877760:12345-0@lo:502: 00000100:00100000:1.0:1787384304.309633:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000afe7c498 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195877760:12345-0@lo:502: Request processed in 154us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384304.309641:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787384304.310797:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000f37bdf4d pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877760:0@lo:502: 00000040:00080000:3.0:1787384304.310999:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1787384304.311026:0:6571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787384304.311738:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384304.311755:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384304.311758:0:6595:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787384304.311764:0:6595:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e3450ec800 00000020:00000080:3.0:1787384304.311766:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384304.311809:0:6595:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384304.311813:0:6595:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384304.311814:0:6595:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787384304.311817:0:6595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787384304.311920:0:6571:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787384304.311940:0:6571:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787384304.311962:0:6571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341677800/0x3522fbed3b6c3196 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.311974:0:6571:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e341677800/0x3522fbed3b6c3196 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384304.312027:0:6571:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787384304.312031:0:6571:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e3450ec800 10000000:01000000:1.0:1787384304.312034:0:6571:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e3450ec800 10000000:01000000:1.0:1787384304.312038:0:6571:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787384304.312043:0:6571:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e3450ec800 from 1 10000000:01000000:1.0:1787384304.312045:0:6571:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787384304.312078:0:6571:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.312247:0:6571:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.312259:0:6571:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384304.312294:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877888:0@lo:101: 00000100:00100000:1.0:1787384304.312355:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.312393:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384304.312437:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195877888 00000100:00100000:2.0:1787384304.312444:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195877888 00000100:00100000:2.0:1787384304.312487:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787384304.312496:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195877888:12345-0@lo:101: 00010000:00010000:2.0:1787384304.312509:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384304.312521:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e3413fc000/0x3522fbed3b6c31ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c31a4 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.312543:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3413fc000/0x3522fbed3b6c31ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c31a4 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.312563:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e3413fc000/0x3522fbed3b6c31ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c31a4 expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.312572:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fc000, rc 0) 00000100:00100000:2.0:1787384304.312609:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6571:x1874208195877888:12345-0@lo:101: Request processed in 114us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384304.312616:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787384304.312745:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195877888:0@lo:101: 00010000:00010000:1.0:1787384304.312758:0:6571:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384304.312766:0:6571:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384304.312841:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195878016:0@lo:501: 00000100:00100000:1.0:1787384304.313641:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.313675:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384304.313750:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195878016 00000100:00100000:2.0:1787384304.313756:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195878016 00000100:00100000:2.0:1787384304.313798:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787384304.313806:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6571:x1874208195878016:12345-0@lo:501: 00000100:00100000:2.0:1787384304.314205:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6571:x1874208195878016:12345-0@lo:501: Request processed in 277us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384304.314212:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787384304.314428:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195878016:0@lo:501: 00000100:00100000:1.0:1787384304.314464:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195878144:0@lo:503: 00000100:00100000:1.0:1787384304.314506:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.314537:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384304.314593:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195878144 00000100:00100000:3.0:1787384304.314598:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195878144 00000100:00100000:3.0:1787384304.314624:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384304.314632:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6571:x1874208195878144:12345-0@lo:503: 00000100:00100000:3.0:1787384304.314784:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6571:x1874208195878144:12345-0@lo:503: Request processed in 152us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384304.314792:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787384304.314959:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195878144:0@lo:503: 00000040:00080000:1.0:1787384304.315329:0:6571:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384304.315405:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195878272:0@lo:502: 00000100:00100000:1.0:1787384304.315436:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.315498:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384304.316314:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195878272 00000100:00100000:2.0:1787384304.316321:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195878272 00000100:00100000:2.0:1787384304.316401:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787384304.316409:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6571:x1874208195878272:12345-0@lo:502: 00000100:00100000:2.0:1787384304.316634:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6571:x1874208195878272:12345-0@lo:502: Request processed in 226us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384304.316642:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787384304.316712:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195878272:0@lo:502: 00000040:00080000:1.0:1787384304.317030:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1787384304.317090:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1787384304.317122:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1787384304.317163:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1787384304.317192:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1787384304.317231:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1787384304.317259:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1787384304.317285:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1787384304.317322:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1787384304.317350:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1787384304.317376:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1787384304.317422:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1787384304.317453:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1787384304.317479:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1787384304.317515:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1787384304.317548:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1787384304.317612:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1787384304.317661:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1787384304.317697:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1787384304.317730:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1787384304.317794:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1787384304.317834:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1787384304.317904:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1787384304.317953:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1787384304.317989:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1787384304.318021:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1787384304.318070:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1787384304.318106:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1787384304.318144:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195878400:0@lo:502: 00000100:00100000:1.0:1787384304.318202:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.318725:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384304.318794:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195878400 00000100:00100000:3.0:1787384304.318801:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195878400 00000100:00100000:3.0:1787384304.318838:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787384304.318846:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6571:x1874208195878400:12345-0@lo:502: 00000100:00100000:3.0:1787384304.319169:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6571:x1874208195878400:12345-0@lo:502: Request processed in 323us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384304.319178:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787384304.319330:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195878400:0@lo:502: 00000040:00080000:1.0:1787384304.319414:0:6571:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1787384304.319434:0:6571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:1.0:1787384304.319912:0:6596:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1787384304.319926:0:6596:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89e3513119c0) 00000020:00000080:1.0:1787384304.319945:0:6596:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:1.0:1787384304.320232:0:6596:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e3450ec800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787384304.320237:0:6596:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e3450ec800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1787384304.320239:0:6596:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e3450ec800 3 00010000:00080000:1.0:1787384304.320263:0:6596:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e377dd6000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1787384304.327732:0:6596:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:1.0:1787384304.327830:0:6596:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1787384304.327887:0:6596:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787384304.327901:0:6596:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3522fbed3b6c31b9 00000100:00080000:1.0:1787384304.327912:0:6596:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384304.327918:0:6596:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e377dd6000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1787384304.327952:0:6596:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37c5ad500 x1874208195878528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384304.327991:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874208195878528:0@lo:38: 00000100:00100000:1.0:1787384304.329303:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787384304.329373:0:6596:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787384304.329575:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195878656:0@lo:400: 00000100:00100000:2.0:1787384304.329612:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384304.331138:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195878528 00000100:00100000:1.0:1787384304.331150:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195878528 00000100:00100000:1.0:1787384304.331187:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195878656 00000100:00100000:1.0:1787384304.331190:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195878656 00000100:00100000:1.0:1787384304.331239:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384304.331249:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195878656:12345-0@lo:400: 00000100:00100000:1.0:1787384304.331320:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195878656:12345-0@lo:400: Request processed in 73us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384304.331327:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384304.331351:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384304.331356:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874208195878528:12345-0@lo:38: 00010000:00080000:1.0:1787384304.331378:0:5783:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:1.0:1787384304.331409:0:5783:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3522fbed3b6c31c0 00000004:00100000:1.0:1787384304.331422:0:5783:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787384304.331452:0:5783:0:(import.c:65:import_set_state_nolock()) ffff89e377902000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384304.331490:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874208195878528:12345-0@lo:38: Request processed in 132us (2191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384304.331497:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787384304.331538:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e37c5ae300 x1874208195878656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384304.331561:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195878656:0@lo:400: 00010000:00080000:1.0:1787384304.331595:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e37c5ad500 x1874208195878528/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384314 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384304.331602:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384304.331608:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1787384304.331614:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1787384304.331619:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787384304.331622:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e377dd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787384304.331627:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874208195878528:0@lo:38: 00000040:00080000:1.0:1787384304.332766:0:6596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1787384304.333061:0:6571:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1787384304.333206:0:6571:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384304.333224:0:6571:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384304.333236:0:6571:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787384304.333295:0:6571:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787384304.333297:0:6571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787384304.333298:0:6571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384304.333300:0:6571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384304.333301:0:6571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384304.333303:0:6571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384304.333304:0:6571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384304.333306:0:6571:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384304.333308:0:6571:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384304.333309:0:6571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384304.333311:0:6571:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384304.333314:0:6571:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1787384304.333317:0:6571:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384304.333318:0:6571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787384304.333319:0:6571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384304.333321:0:6571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384304.333322:0:6571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384304.333323:0:6571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384304.333324:0:6571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384304.333325:0:6571:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384304.333326:0:6571:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384304.333327:0:6571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384304.333328:0:6571:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384304.333348:0:6571:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1787384304.333363:0:6571:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195878784:0@lo:253: 00000100:00100000:3.0:1787384304.333416:0:6571:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384304.333455:0:6571:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e36626a840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384304.333737:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195878784 00000100:00100000:1.0:1787384304.333745:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195878784 00000100:00100000:1.0:1787384304.333787:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787384304.333796:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6571:x1874208195878784:12345-0@lo:253: 20000000:01000000:1.0:1787384304.333827:0:5778:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787384304.333839:0:5778:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1787384304.360667:0:5778:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787384304.360714:0:5778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787384304.363379:0:5799:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787384304.363389:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787384304.363417:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.363436:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c3134 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c312d expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.363445:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.363488:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c3134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c312d expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.363505:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c3134 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c312d expref: 12 pid: 5777 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384304.363519:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1874208195878912:0@lo:104: 00000100:00100000:2.0:1787384304.363591:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.364186:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351fae540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384304.364338:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195878912 00000100:00100000:0.0:1787384304.364346:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195878912 00000100:00100000:0.0:1787384304.364394:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384304.364403:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5799:x1874208195878912:12345-0@lo:104: 00010000:00010000:0.0:1787384304.364416:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c312d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.364496:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384304.364503:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5799:x1874208195878912:12345-0@lo:104: Request processed in 100us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384304.364510:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787384304.364531:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384304.364537:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c312d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.364543:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fdc00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384304.364547:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c312d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.364565:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c312d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384304.364571:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c312d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384304.364576:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384304.364603:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c312d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.364608:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384304.364621:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c312d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.364626:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c312d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3134 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.364651:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384304.364653:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384304.364655:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384304.364693:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384304.364706:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195879040:0@lo:103: 00000100:00100000:1.0:1787384304.364752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384304.364999:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ea00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1874208195878912:0@lo:104: 00010000:00010000:2.0:1787384304.365151:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384304.365976:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195879040 00000100:00100000:0.0:1787384304.365985:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195879040 00010000:00010000:0.0:1787384304.366023:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c3134 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c312d expref: 13 pid: 5777 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384304.366056:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384304.366065:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349e10050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:3304:x1874208195879040:12345-0@lo:103: 00010000:00010000:0.0:1787384304.366089:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384304.366094:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c3134 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c312d expref: 13 pid: 5777 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366106:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c3134 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c312d expref: 13 pid: 5777 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366124:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c3134 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c312d expref: 13 pid: 5777 timeout: 315 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366140:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366148:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1787384304.366163:0:5768:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002972232s 00010000:00010000:0.0:1787384304.366168:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366189:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366195:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366201:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366207:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd000 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384304.366211:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366219:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366233:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384304.366243:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384304.366299:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349e10050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:3304:x1874208195879040:12345-0@lo:103: Request processed in 235us (1545us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384304.366306:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384304.367232:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195879040:0@lo:103: 00010000:00010000:2.0:1787384304.367370:0:5799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.367382:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384304.367389:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3413fd000/0x3522fbed3b6c31c7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384304.371654:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:6571:x1874208195878784:12345-0@lo:253: Request processed in 37851us (38230us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384304.371669:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384304.371746:0:6571:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6571:1874208195878784:0@lo:253: 10000000:01000000:3.0:1787384304.371760:0:6571:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787384304.371763:0:6571:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384304.371764:0:6571:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787384304.371765:0:6571:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384304.371781:0:6571:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384304.371783:0:6571:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384304.371784:0:6571:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384304.371785:0:6571:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384304.371787:0:6571:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384304.371788:0:6571:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384304.371790:0:6571:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384304.371791:0:6571:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787384304.371805:0:6571:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787384304.377516:0:6571:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787384304.377732:0:6571:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787384304.377985:0:6571:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787384304.378152:0:6571:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787384304.378361:0:6571:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787384304.378613:0:6571:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787384304.380483:0:6571:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1787384304.651819:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1787384304.708797:0:6571:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787384304.708805:0:6571:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787384304.708837:0:6571:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787384304.708925:0:6571:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787384304.708952:0:6571:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787384304.708985:0:6571:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 10000000:01000000:1.0:1787384305.614386:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1787384305.614394:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e348611800 from 21 10000000:01000000:1.0:1787384305.614400:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787384305.614444:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.614458:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.614470:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384305.614494:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195879168:0@lo:101: 00000100:00100000:1.0:1787384305.614575:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.614629:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.614662:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195879168 00000100:00100000:1.0:1787384305.614669:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195879168 00000100:00100000:1.0:1787384305.614717:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787384305.614726:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:5780:x1874208195879168:12345-0@lo:101: 00010000:00010000:1.0:1787384305.614739:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384305.614750:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e341677400/0x3522fbed3b6c31d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c31ce expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.614771:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e341677400/0x3522fbed3b6c31d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c31ce expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.614790:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e341677400/0x3522fbed3b6c31d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c31ce expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.614799:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e341677400, rc 0) 00000100:00100000:1.0:1787384305.614838:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5780:x1874208195879168:12345-0@lo:101: Request processed in 114us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.614845:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787384305.614910:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195879168:0@lo:101: 00010000:00010000:1.0:1787384305.614924:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.614931:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384305.614978:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195879296:0@lo:501: 00000100:00100000:1.0:1787384305.615002:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.615022:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.615035:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195879296 00000100:00100000:1.0:1787384305.615038:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195879296 00000100:00100000:1.0:1787384305.615058:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787384305.615064:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5780:x1874208195879296:12345-0@lo:501: 00000100:00100000:1.0:1787384305.615399:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5780:x1874208195879296:12345-0@lo:501: Request processed in 333us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.615406:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787384305.615438:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195879296:0@lo:501: 00000100:00100000:1.0:1787384305.615462:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195879424:0@lo:503: 00000100:00100000:1.0:1787384305.615505:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.615519:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb40c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.615532:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195879424 00000100:00100000:1.0:1787384305.615536:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195879424 00000100:00100000:1.0:1787384305.615591:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787384305.615597:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5780:x1874208195879424:12345-0@lo:503: 00000100:00100000:1.0:1787384305.615900:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5780:x1874208195879424:12345-0@lo:503: Request processed in 301us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.615908:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787384305.615949:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195879424:0@lo:503: 00000100:00100000:1.0:1787384305.616153:0:6635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6635:1874208195879552:0@lo:502: 00000100:00100000:1.0:1787384305.616187:0:6635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.616206:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195879552 00000100:00100000:1.0:1787384305.616209:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195879552 00000100:00100000:1.0:1787384305.616228:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787384305.616234:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6635:x1874208195879552:12345-0@lo:502: 00000100:00100000:1.0:1787384305.616413:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6635:x1874208195879552:12345-0@lo:502: Request processed in 178us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.616420:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1787384305.616456:0:6635:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3742f89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.616468:0:6635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6635:1874208195879552:0@lo:502: 00000100:00100000:1.0:1787384305.616505:0:6635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6635:1874208195879680:0@lo:502: 00000100:00100000:1.0:1787384305.616538:0:6635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.620247:0:6635:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c2943c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384305.627170:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195879680 00000100:00100000:3.0:1787384305.627188:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195879680 00000100:00100000:3.0:1787384305.627632:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787384305.627643:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6635:x1874208195879680:12345-0@lo:502: 00000100:00100000:3.0:1787384305.627960:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:6635:x1874208195879680:12345-0@lo:502: Request processed in 318us (11420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384305.627969:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1787384305.628080:0:6635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6635:1874208195879680:0@lo:502: 00000040:00080000:2.0:1787384305.628115:0:6635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787384305.633236:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787384305.633275:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384305.633295:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.633309:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384305.633318:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787384305.633321:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89e348611800 from 4 10000000:01000000:1.0:1787384305.633323:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787384305.633600:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.633610:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.633621:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384305.633645:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195879808:0@lo:101: 00000100:00100000:1.0:1787384305.633712:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.633755:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c2940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.633783:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195879808 00000100:00100000:1.0:1787384305.633789:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195879808 00000100:00100000:1.0:1787384305.633829:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787384305.633838:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5780:x1874208195879808:12345-0@lo:101: 00010000:00010000:1.0:1787384305.633849:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384305.633880:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e341676200/0x3522fbed3b6c31e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c31dc expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.633903:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e341676200/0x3522fbed3b6c31e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c31dc expref: 13 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.633923:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e341676200/0x3522fbed3b6c31e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c31dc expref: 13 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.633931:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e341676200, rc 0) 00000100:00100000:1.0:1787384305.633966:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195879808:12345-0@lo:101: Request processed in 129us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.633973:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787384305.634017:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195879808:0@lo:101: 00010000:00010000:1.0:1787384305.634030:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.634038:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384305.634573:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195879936:0@lo:256: 00000100:00100000:1.0:1787384305.634613:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.634679:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c2940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.634697:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195879936 00000100:00100000:1.0:1787384305.634701:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195879936 00000100:00100000:1.0:1787384305.634725:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787384305.634732:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195879936:12345-0@lo:256: 20000000:01000000:1.0:1787384305.634746:0:5777:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787384305.634762:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787384305.634765:0:5777:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1787384305.634847:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195879936:12345-0@lo:256: Request processed in 114us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.634855:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787384305.634915:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195879936:0@lo:256: 10000000:01000000:1.0:1787384305.634958:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787384305.634966:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.634975:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384305.634982:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787384305.634984:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787384305.634987:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787384305.635005:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.635011:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.635020:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384305.635030:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195880064:0@lo:101: 00000100:00100000:1.0:1787384305.635052:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.635064:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c2940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.635087:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195880064 00000100:00100000:1.0:1787384305.635090:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195880064 00000100:00100000:1.0:1787384305.635107:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787384305.635112:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195880064:12345-0@lo:101: 00010000:00010000:1.0:1787384305.635119:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384305.635129:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e341676c00/0x3522fbed3b6c31f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c31ea expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.635149:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e341676c00/0x3522fbed3b6c31f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c31ea expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.635158:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e341676c00/0x3522fbed3b6c31f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c31ea expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.635165:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e341676c00, rc 0) 00000100:00100000:1.0:1787384305.635192:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195880064:12345-0@lo:101: Request processed in 80us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.635198:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787384305.635223:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195880064:0@lo:101: 00010000:00010000:1.0:1787384305.635246:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.635255:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384305.635293:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195880192:0@lo:501: 00000100:00100000:1.0:1787384305.635316:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.635328:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c2940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.635338:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195880192 00000100:00100000:1.0:1787384305.635341:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195880192 00000100:00100000:1.0:1787384305.635367:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787384305.635373:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195880192:12345-0@lo:501: 00000100:00100000:1.0:1787384305.637023:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195880192:12345-0@lo:501: Request processed in 1641us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.637033:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787384305.637093:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195880192:0@lo:501: 00000100:00100000:1.0:1787384305.637132:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195880320:0@lo:503: 00000100:00100000:1.0:1787384305.637172:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.637196:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c2940c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.637210:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195880320 00000100:00100000:1.0:1787384305.637214:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195880320 00000100:00100000:1.0:1787384305.637250:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787384305.637258:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195880320:12345-0@lo:503: 00000100:00100000:1.0:1787384305.638970:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195880320:12345-0@lo:503: Request processed in 1704us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.638983:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787384305.639367:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ae300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195880320:0@lo:503: 00000100:00100000:1.0:1787384305.649654:0:6638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6638:1874208195880448:0@lo:502: 00000100:00100000:1.0:1787384305.649741:0:6638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384305.649793:0:6638:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3507aaa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384305.649940:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195880448 00000100:00100000:3.0:1787384305.649948:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195880448 00000100:00100000:3.0:1787384305.650001:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787384305.650011:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:6638:x1874208195880448:12345-0@lo:502: 00000100:00100000:3.0:1787384305.650840:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:6638:x1874208195880448:12345-0@lo:502: Request processed in 826us (1094us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384305.650887:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787384305.651137:0:6638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5adc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6638:1874208195880448:0@lo:502: 00000020:01000000:2.0:1787384305.651170:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787384305.651179:0:6638:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787384305.651187:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384305.651189:0:6638:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787384305.651195:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787384305.651199:0:6638:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:2.0:1787384305.651222:0:6638:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787384305.651364:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384305.651378:0:6638:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89e351f60000) 00000020:00000080:2.0:1787384305.651399:0:6638:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787384305.651405:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787384305.651627:0:6638:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787384305.651633:0:6638:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787384305.651649:0:6638:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c31ff 00010000:00080000:2.0:1787384305.651698:0:6638:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e377b35800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1787384305.651989:0:6638:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00010000:00010000:0.0:1787384305.673159:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787384305.766907:0:6638:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1787384305.766930:0:6638:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1787384305.768896:0:6638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384305.769098:0:6638:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384305.769151:0:6638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1787384305.769212:0:6638:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1787384305.770205:0:6653:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384305.770211:0:6653:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787384305.771127:0:6638:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384305.771140:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787384305.771191:0:6638:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787384305.771212:0:6638:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3522fbed3b6c3206 00000100:00080000:0.0:1787384305.771296:0:6638:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384305.771305:0:6638:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e377b35800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1787384305.771342:0:6638:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e344263480 x1874208195880576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384305.771396:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195880576:0@lo:8: 00000100:00100000:1.0:1787384305.771550:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787384305.771623:0:6638:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1787384305.771686:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384305.771691:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384305.771693:0:6638:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1787384305.771696:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384305.771700:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384305.771701:0:6638:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787384305.771704:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787384305.771706:0:6638:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787384305.771731:0:6638:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6638:1874208195880704:0@lo:502: 00000100:00100000:0.0:1787384305.771778:0:6638:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384305.771825:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195880576 00000100:00100000:3.0:1787384305.771832:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195880576 00000100:00100000:3.0:1787384305.771885:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384305.771893:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874208195880576:12345-0@lo:8: 00010000:00080000:3.0:1787384305.771917:0:6574:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 166 last 0 00000020:00000080:3.0:1787384305.771942:0:6574:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3522fbed3b6c320d 00002000:00100000:3.0:1787384305.771972:0:6574:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89e377d8f000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1787384305.771977:0:6574:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1787384305.771981:0:6574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787384305.772090:0:6574:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787384305.772232:0:6574:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787384305.772256:0:6574:0:(import.c:65:import_set_state_nolock()) ffff89e377d8a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384305.776276:0:6638:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384305.776889:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195880704 00000100:00100000:2.0:1787384305.776899:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195880704 00000100:00100000:2.0:1787384305.776958:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787384305.776968:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:6638:x1874208195880704:12345-0@lo:502: 00000100:00100000:2.0:1787384305.777319:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:6638:x1874208195880704:12345-0@lo:502: Request processed in 352us (5540us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384305.777328:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787384305.777397:0:6638:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6638:1874208195880704:0@lo:502: 00000020:01000000:2.0:1787384305.777429:0:6638:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384305.777566:0:6638:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384305.777570:0:6638:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787384305.777577:0:6638:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787384305.777704:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787384305.777720:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787384305.777731:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384305.777742:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384305.777752:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787384305.777755:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e348611800 from 1 10000000:01000000:2.0:1787384305.777758:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384305.777787:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384305.777795:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384305.777812:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384305.777831:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195880832:0@lo:101: 00000100:00100000:2.0:1787384305.777893:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384305.777915:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347a04d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384305.778361:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195880832 00000100:00100000:0.0:1787384305.778367:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195880832 00000100:00100000:0.0:1787384305.778400:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787384305.778407:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195880832:12345-0@lo:101: 00010000:00010000:0.0:1787384305.778418:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384305.778430:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c321b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3214 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384305.778463:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c321b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3214 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384305.778474:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c321b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3214 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384305.778610:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a800, rc 0) 00000100:00100000:0.0:1787384305.778651:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195880832:12345-0@lo:101: Request processed in 244us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384305.778658:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787384305.778751:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874208195880576:12345-0@lo:8: Request processed in 6856us (7270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384305.778761:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384305.778984:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195880960:0@lo:400: 00000100:00100000:0.0:1787384305.779015:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384305.779039:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384305.779045:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195881088:0@lo:400: 00000100:00100000:0.0:1787384305.779072:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384305.779574:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195880832:0@lo:101: 00010000:00010000:2.0:1787384305.779594:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384305.779604:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384305.779656:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195881216:0@lo:501: 00000100:00100000:2.0:1787384305.779683:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384305.779743:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347a04d80 going to sleep for 11 seconds 00010000:00080000:1.0:1787384305.781372:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344263480 x1874208195880576/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384305.781386:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787384305.781394:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1787384305.781402:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1787384305.781407:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1787384305.781410:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e377b35800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1787384305.781426:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1787384305.781432:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195880576:0@lo:8: 00000100:00100000:1.0:1787384305.781492:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195880960 00000100:00100000:1.0:1787384305.781505:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195880960 00000100:00100000:1.0:1787384305.781553:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195881088 00000100:00100000:1.0:1787384305.781557:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195881088 00000100:00100000:1.0:1787384305.781586:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384305.781594:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195880960:12345-0@lo:400: 00000100:00100000:1.0:1787384305.781660:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344260a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195880960:12345-0@lo:400: Request processed in 65us (2642us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.781666:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384305.781683:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384305.781689:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195881088:12345-0@lo:400: 00000100:00100000:1.0:1787384305.781716:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344261f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195881088:12345-0@lo:400: Request processed in 28us (2644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.781722:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787384305.781758:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344263b80 x1874208195881088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384305.781769:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195881088:0@lo:400: 00010000:00080000:1.0:1787384305.781779:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344261880 x1874208195880960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384321 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384305.781786:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195880960:0@lo:400: 00000004:00080000:1.0:1787384305.781808:0:6653:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1787384305.781959:0:6653:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 166925097927ns, next at 0ns, rc = 0 00000100:00080000:3.0:1787384305.785066:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384305.788356:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195881216 00000100:00100000:0.0:1787384305.788371:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195881216 00000100:00100000:0.0:1787384305.788455:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787384305.788466:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195881216:12345-0@lo:501: 00000100:00100000:0.0:1787384305.788772:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195881216:12345-0@lo:501: Request processed in 308us (9086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384305.788787:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787384305.789043:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195881216:0@lo:501: 00000100:00100000:2.0:1787384305.789093:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195881344:0@lo:503: 00000100:00100000:2.0:1787384305.789140:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384305.789184:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347a04d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384305.789199:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195881344 00000100:00100000:2.0:1787384305.789204:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195881344 00000100:00100000:2.0:1787384305.789648:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787384305.789658:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195881344:12345-0@lo:503: 00000100:00100000:2.0:1787384305.789970:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195881344:12345-0@lo:503: Request processed in 313us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384305.789984:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787384305.792761:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195881344:0@lo:503: 00000100:00100000:0.0:1787384305.806815:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6655:1874208195881472:0@lo:502: 00000100:00100000:0.0:1787384305.806925:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384305.806964:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195881472 00000100:00100000:0.0:1787384305.806971:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195881472 00000100:00100000:0.0:1787384305.807013:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787384305.807022:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:6655:x1874208195881472:12345-0@lo:502: 00000100:00100000:2.0:1787384305.816137:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384305.822972:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:6655:x1874208195881472:12345-0@lo:502: Request processed in 15943us (16039us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384305.822985:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787384305.823081:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6655:1874208195881472:0@lo:502: 00000020:01000000:3.0:1787384305.823112:0:6655:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384305.823121:0:6655:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384305.823124:0:6655:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787384305.823131:0:6655:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e348611800 00000020:00000080:3.0:1787384305.823134:0:6655:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787384305.823170:0:6655:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6655:1874208195881600:0@lo:502: 00000100:00100000:3.0:1787384305.823218:0:6655:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384305.824692:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195881600 00000100:00100000:0.0:1787384305.824703:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195881600 00000100:00100000:0.0:1787384305.824793:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787384305.824803:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:6655:x1874208195881600:12345-0@lo:502: 00000100:00100000:0.0:1787384305.825035:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:6655:x1874208195881600:12345-0@lo:502: Request processed in 232us (1815us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384305.825043:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787384305.825276:0:6655:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34b629f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384305.825303:0:6655:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:6655:1874208195881600:0@lo:502: 00000020:01000000:3.0:1787384305.825332:0:6655:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384305.825340:0:6655:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384305.825342:0:6655:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787384305.825347:0:6655:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:3.0:1787384305.827807:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787384305.827840:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384305.827850:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384305.830713:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:3.0:1787384305.836849:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384305.836913:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787384305.836916:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89e351ef8000 from 1 10000000:01000000:3.0:1787384305.836919:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787384305.836956:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384305.836966:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384305.836977:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384305.837000:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195881728:0@lo:101: 00000100:00100000:3.0:1787384305.837064:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384305.837121:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34b629f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.839707:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195881728 00000100:00100000:1.0:1787384305.839721:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195881728 00000100:00100000:1.0:1787384305.839777:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787384305.839787:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195881728:12345-0@lo:101: 00010000:00010000:1.0:1787384305.839802:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384305.839826:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c3229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3222 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.839856:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c3229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3222 expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.839886:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c3229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3222 expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384305.839895:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e341677c00, rc 0) 00000100:00100000:1.0:1787384305.839971:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195881728:12345-0@lo:101: Request processed in 186us (2906us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384305.839978:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787384305.840399:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195881728:0@lo:101: 00010000:00010000:3.0:1787384305.840419:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384305.840438:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384305.840528:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195881856:0@lo:501: 00000100:00100000:3.0:1787384305.840574:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384305.840604:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34b629f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384305.841847:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195881856 00000100:00100000:1.0:1787384305.841872:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195881856 00000100:00100000:1.0:1787384305.841916:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787384305.841926:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195881856:12345-0@lo:501: 00000100:00100000:1.0:1787384305.842197:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195881856:12345-0@lo:501: Request processed in 272us (1622us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787384305.842206:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1787384305.843214:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195881856:0@lo:501: 10000000:01000000:3.0:1787384305.843272:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787384305.843282:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384305.843294:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384305.895810:0:6654:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787384305.895840:0:6654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6654:1874208195882112:0@lo:7: 00000100:00100000:0.0:1787384305.895933:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384305.895973:0:6654:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384305.896005:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195881984:0@lo:13: 00000100:00100000:0.0:1787384305.896031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384305.896601:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195882112 00000100:00100000:3.0:1787384305.896611:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195882112 00000100:00100000:3.0:1787384305.896675:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384305.896685:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6654:x1874208195882112:12345-0@lo:7: 00000100:00080000:0.0:1787384305.897832:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384305.898033:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195881984 00000100:00100000:2.0:1787384305.898041:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195881984 00000100:00100000:2.0:1787384305.898151:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384305.898161:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874208195881984:12345-0@lo:13: 00002000:00000024:2.0:1787384305.898189:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787384305.898256:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344263100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874208195881984:12345-0@lo:13: Request processed in 97us (2224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384305.898264:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787384305.898311:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344260000 x1874208195881984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384305.898331:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195881984:0@lo:13: 00002000:00080000:3.0:1787384305.910692:0:6576:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1787384305.910701:0:6576:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1787384305.910843:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344261180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6654:x1874208195882112:12345-0@lo:7: Request processed in 14155us (14905us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384305.910854:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787384305.915010:0:6654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344262d80 x1874208195882112/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787384321 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384305.915035:0:6654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6654:1874208195882112:0@lo:7: 00000004:00080000:0.0:1787384305.915050:0:6654:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1787384305.915599:0:6654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6654:1874208195882240:0@lo:5: 00000100:00100000:0.0:1787384305.915654:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384305.915745:0:6654:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384305.917179:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195882240 00000100:00100000:3.0:1787384305.917192:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195882240 00000100:00100000:3.0:1787384305.917234:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384305.917243:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6654:x1874208195882240:12345-0@lo:5: 00002000:00080000:3.0:1787384305.917275:0:6575:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787384305.917278:0:6575:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787384305.917609:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344261880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6654:x1874208195882240:12345-0@lo:5: Request processed in 366us (1953us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787384305.917618:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787384305.917779:0:6654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344262d80 x1874208195882240/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384321 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384305.917795:0:6654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6654:1874208195882240:0@lo:5: 00000004:00080000:0.0:1787384305.917808:0:6654:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1787384305.917840:0:6654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6654:1874208195882368:0@lo:700: 00000100:00100000:0.0:1787384305.917893:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384305.917912:0:6654:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384305.919242:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195882368 00000100:00100000:3.0:1787384305.919253:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195882368 00000100:00100000:3.0:1787384305.919304:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384305.919314:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6654:x1874208195882368:12345-0@lo:700: 00000100:00100000:3.0:1787384305.919357:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6582:1874208195882496:0@lo:700: 00000100:00100000:3.0:1787384305.919423:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384305.919447:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34b629d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384305.919510:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195882496 00000100:00100000:0.0:1787384305.919514:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195882496 00000100:00100000:0.0:1787384305.921851:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384305.921891:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6582:x1874208195882496:12345-0@lo:700: 40000000:02000000:2.0:1787384305.956788:0:5790:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787384305.969316:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6582:x1874208195882496:12345-0@lo:700: Request processed in 47425us (49882us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384305.969339:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787384305.972598:0:6582:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37273e680 x1874208195882496/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787384321 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384305.972619:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6582:1874208195882496:0@lo:700: 40000000:02000000:2.0:1787384305.972633:0:6582:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:0.0:1787384306.146202:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:0.0:1787384306.146219:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1787384306.146518:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344263480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6654:x1874208195882368:12345-0@lo:700: Request processed in 227201us (228619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384306.146558:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787384306.146996:0:6654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344263b80 x1874208195882368/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787384321 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384306.147009:0:6654:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787384306.147026:0:6654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6654:1874208195882368:0@lo:700: 00000004:02000040:0.0:1787384306.177391:0:6654:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1787384306.182783:0:6654:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6654:1874208195882624:0@lo:5: 00000100:00100000:0.0:1787384306.182855:0:6654:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384306.183372:0:6654:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db53c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384306.185036:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195882624 00000100:00100000:3.0:1787384306.185051:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195882624 00000100:00100000:3.0:1787384306.185116:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384306.185126:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6654:x1874208195882624:12345-0@lo:5: 00002000:00080000:3.0:1787384306.191028:0:6576:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787384306.191048:0:6576:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:2.0:1787384306.194807:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6654:x1874208195882624:12345-0@lo:5: Request processed in 9675us (11944us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787384306.194824:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787384306.194976:0:6654:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344263b80 x1874208195882624/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384322 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384306.194992:0:6654:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6654:1874208195882624:0@lo:5: 00000004:00080000:0.0:1787384306.195006:0:6654:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:1.0:1787384306.698807:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384307.736503:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384308.746096:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384309.773316:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384310.804537:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384310.857146:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195882752:0@lo:400: 00000100:00100000:1.0:1787384310.857240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384310.857295:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384310.857302:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195883136:0@lo:400: 00000100:00100000:1.0:1787384310.857412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384310.857467:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195882880:0@lo:400: 00000100:00100000:1.0:1787384310.857494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384310.857527:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384310.857533:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195883008:0@lo:400: 00000100:00100000:1.0:1787384310.857554:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384310.857588:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195882752 00000100:00100000:1.0:1787384310.857596:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195882752 00000100:00100000:1.0:1787384310.857723:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384310.857733:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3305:x1874208195882752:12345-0@lo:400: 00000100:00100000:1.0:1787384310.857787:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3305:x1874208195882752:12345-0@lo:400: Request processed in 55us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384310.857794:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384310.857833:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195883136 00000100:00100000:1.0:1787384310.857837:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195883136 00000100:00100000:1.0:1787384310.857907:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384310.857916:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195883136:12345-0@lo:400: 00000100:00100000:1.0:1787384310.858035:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5adc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195883136:12345-0@lo:400: Request processed in 119us (703us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384310.858041:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384310.858061:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195882880 00000100:00100000:1.0:1787384310.858065:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195882880 00000100:00100000:1.0:1787384310.858089:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195883008 00000100:00100000:1.0:1787384310.858092:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195883008 00000100:00100000:1.0:1787384310.858107:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384310.858113:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195882880:12345-0@lo:400: 00000100:00100000:1.0:1787384310.858147:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195882880:12345-0@lo:400: Request processed in 35us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384310.858153:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787384310.858174:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384310.858180:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195883008:12345-0@lo:400: 00000100:00100000:1.0:1787384310.858209:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195883008:12345-0@lo:400: Request processed in 29us (653us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384310.858215:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787384310.858237:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384310.858242:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384310.858276:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5afb80 x1874208195883008/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384310.858289:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195883008:0@lo:400: 00010000:00080000:1.0:1787384310.858300:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5ad880 x1874208195882880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384310.858309:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195882880:0@lo:400: 00010000:00080000:1.0:1787384310.858714:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5af480 x1874208195883136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384326 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384310.858725:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195883136:0@lo:400: 00000100:00100000:1.0:1787384310.858736:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195882752:0@lo:400: 00000100:00100000:1.0:1787384311.382585:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195883264:0@lo:13: 00000100:00100000:1.0:1787384311.382655:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384311.382809:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195883264 00000100:00100000:2.0:1787384311.382818:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195883264 00000100:00100000:2.0:1787384311.382879:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384311.382889:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195883264:12345-0@lo:13: 00002000:00000024:2.0:1787384311.382920:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384311.382963:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195883264:12345-0@lo:13: Request processed in 76us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384311.382970:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787384311.383006:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5ac380 x1874208195883264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384327 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384311.383024:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195883264:0@lo:13: 00000001:00080000:1.0:1787384311.536778:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:3.0:1787384311.820400:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787384311.861480:0:6947:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787384312.842019:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384313.866040:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384314.891235:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384315.914963:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384315.980090:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195883776:0@lo:400: 00000100:00100000:0.0:1787384315.980155:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384315.980203:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384315.980209:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195883648:0@lo:400: 00000100:00100000:0.0:1787384315.980232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384315.980344:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195883392:0@lo:400: 00000100:00100000:1.0:1787384315.980381:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384315.980425:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384315.980430:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195883520:0@lo:400: 00000100:00100000:1.0:1787384315.980460:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384315.980504:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195883648 00000100:00100000:1.0:1787384315.980511:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195883648 00000100:00100000:1.0:1787384315.980555:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195883520 00000100:00100000:1.0:1787384315.980558:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195883520 00000100:00100000:1.0:1787384315.980572:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787384315.980579:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195883648:12345-0@lo:400: 00000100:00100000:1.0:1787384315.980626:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344261500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195883648:12345-0@lo:400: Request processed in 46us (392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384315.980644:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787384315.980660:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384315.980666:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195883520:12345-0@lo:400: 00000100:00100000:1.0:1787384315.980691:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195883520:12345-0@lo:400: Request processed in 26us (232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384315.980696:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:1.0:1787384315.980711:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787384315.980735:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344262300 x1874208195883520/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384315.980747:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195883520:0@lo:400: 00010000:00080000:1.0:1787384315.980780:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344262680 x1874208195883648/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384315.980789:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195883648:0@lo:400: 00000100:00100000:2.0:1787384315.981158:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195883776 00000100:00100000:2.0:1787384315.981163:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195883776 00000100:00100000:2.0:1787384315.981193:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384315.981200:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195883776:12345-0@lo:400: 00000100:00100000:2.0:1787384315.981236:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344260e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195883776:12345-0@lo:400: Request processed in 36us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384315.981242:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1787384315.981925:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384315.981967:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e344263800 x1874208195883776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384331 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384315.981977:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787384315.981997:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195883776:0@lo:400: 00000100:00100000:0.0:1787384315.982753:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195883392 00000100:00100000:0.0:1787384315.982772:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195883392 00000100:00100000:0.0:1787384315.982854:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787384315.982884:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3306:x1874208195883392:12345-0@lo:400: 00000100:00100000:0.0:1787384315.982966:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3306:x1874208195883392:12345-0@lo:400: Request processed in 84us (2583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384315.982973:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787384315.983275:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195883392:0@lo:400: 00000100:00100000:2.0:1787384316.491008:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195883904:0@lo:13: 00000100:00100000:2.0:1787384316.491083:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384316.491164:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195883904 00000100:00100000:2.0:1787384316.491172:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195883904 00000100:00100000:2.0:1787384316.491511:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384316.491520:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195883904:12345-0@lo:13: 00002000:00000024:2.0:1787384316.491551:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384316.491597:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195883904:12345-0@lo:13: Request processed in 78us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384316.491604:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787384316.493801:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c39ea00 x1874208195883904/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384332 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384316.493827:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195883904:0@lo:13: 00010000:00010000:3.0:1787384316.953079:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384317.962299:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384318.995734:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384320.019791:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384321.033624:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384321.098158:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195884160:0@lo:400: 00000100:00100000:1.0:1787384321.098231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384321.098292:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384321.098298:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195884288:0@lo:400: 00000100:00100000:1.0:1787384321.098324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384321.098361:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195884160 00000100:00100000:1.0:1787384321.098369:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195884160 00000100:00100000:1.0:1787384321.098407:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195884288 00000100:00100000:1.0:1787384321.098410:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195884288 00000100:00100000:1.0:1787384321.098445:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787384321.098460:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195884160:12345-0@lo:400: 00000100:00100000:1.0:1787384321.098509:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195884160:12345-0@lo:400: Request processed in 56us (278us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384321.098516:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787384321.098534:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384321.098540:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195884288:12345-0@lo:400: 00000100:00100000:1.0:1787384321.098566:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195884288:12345-0@lo:400: Request processed in 26us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384321.098572:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787384321.098595:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787384321.098625:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5af800 x1874208195884288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384321.098637:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195884288:0@lo:400: 00010000:00080000:1.0:1787384321.098648:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5ae680 x1874208195884160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384321.098673:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195884160:0@lo:400: 00000100:00100000:2.0:1787384321.098885:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195884032:0@lo:400: 00000100:00100000:2.0:1787384321.098935:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384321.098963:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384321.098969:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195884416:0@lo:400: 00000100:00100000:2.0:1787384321.099001:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384321.099029:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195884416 00000100:00100000:2.0:1787384321.099033:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195884416 00000100:00100000:2.0:1787384321.099067:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384321.099073:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195884416:12345-0@lo:400: 00000100:00100000:2.0:1787384321.099109:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195884416:12345-0@lo:400: Request processed in 36us (107us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384321.099115:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787384321.099132:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384321.099149:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5ac000 x1874208195884416/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384337 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384321.099159:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195884416:0@lo:400: 00000100:00100000:1.0:1787384321.099362:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195884032 00000100:00100000:1.0:1787384321.099367:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195884032 00000100:00100000:1.0:1787384321.099445:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384321.099460:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3307:x1874208195884032:12345-0@lo:400: 00000100:00100000:1.0:1787384321.099502:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3307:x1874208195884032:12345-0@lo:400: Request processed in 50us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384321.099509:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787384321.099570:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195884032:0@lo:400: 00000100:00100000:0.0:1787384321.611139:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195884544:0@lo:13: 00000100:00100000:0.0:1787384321.611216:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384321.611346:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195884544 00000100:00100000:3.0:1787384321.611354:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195884544 00000100:00100000:3.0:1787384321.611408:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384321.611418:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195884544:12345-0@lo:13: 00002000:00000024:3.0:1787384321.611465:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384321.611511:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195884544:12345-0@lo:13: Request processed in 94us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384321.611519:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787384321.611646:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37273dc00 x1874208195884544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384337 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384321.611679:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195884544:0@lo:13: 00010000:00010000:1.0:1787384322.072548:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384323.084273:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384324.105678:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787384324.356152:0:7466:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787384324.356156:0:7466:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787384324.356298:0:7466:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89e349e43000 00000020:01000004:3.0:1787384324.356314:0:7466:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787384324.356328:0:7466:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787384324.356342:0:7466:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89e3741a3380) 00000020:00000080:3.0:1787384324.356359:0:7466:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787384324.384333:0:7466:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787384324.384590:0:7466:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787384324.420289:0:7466:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1787384324.429381:0:7466:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1787384324.429428:0:7466:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1787384324.429488:0:7466:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1787384324.429517:0:7466:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787384324.430230:0:7466:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787384324.430243:0:7466:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787384324.430254:0:7466:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3522fbed3b6c3237 00000020:01000004:3.0:1787384324.430261:0:7466:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787384324.430283:0:7466:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787384324.430286:0:7466:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787384324.430292:0:7466:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787384324.430322:0:7466:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787384324.430327:0:7466:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787384324.451514:0:7466:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787384324.451554:0:7466:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.151@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787384324.451558:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787384324.451560:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787384324.451561:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384324.451562:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384324.451564:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384324.451565:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384324.451566:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787384324.451568:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787384324.451569:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787384324.451571:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384324.451572:0:7466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787384324.451576:0:7466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787384324.451579:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787384324.451580:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787384324.451581:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787384324.451582:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787384324.451583:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787384324.451584:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787384324.451585:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787384324.451586:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787384324.451587:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787384324.451587:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787384324.451588:0:7466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787384324.451614:0:7466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787384324.451808:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195884672:0@lo:253: 00000100:00100000:2.0:1787384324.452830:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.453240:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffeb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.453443:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195884672 00000100:00100000:1.0:1787384324.453451:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195884672 00000100:00100000:1.0:1787384324.453545:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384324.453556:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:7466:x1874208195884672:12345-0@lo:253: 20000000:01000000:1.0:1787384324.453590:0:5778:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787384324.453595:0:5778:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1787384324.453599:0:5778:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1787384324.453603:0:5778:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1787384324.454651:0:5778:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384324.454894:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787384324.454909:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787384324.454949:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787384324.454957:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787384324.454989:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787384324.455036:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787384324.455387:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787384324.455407:0:5778:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.151@tcp 20000000:01000000:1.0:1787384324.455409:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787384324.455455:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787384324.455470:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787384324.455522:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787384324.455530:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:1.0:1787384324.455562:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787384324.455571:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787384324.455600:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787384324.455650:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787384324.456375:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787384324.456392:0:5778:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.203.151@tcp 20000000:01000000:1.0:1787384324.456394:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.151@tcp (null) (null) (null) 00000040:00080000:1.0:1787384324.457685:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787384324.457702:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787384324.457748:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787384324.457754:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.151@tcp (null) (null) 00000040:00080000:1.0:1787384324.457842:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787384324.457854:0:5778:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787384324.458079:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787384324.458119:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787384324.458140:0:5778:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1787384324.458142:0:5778:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1787384324.458148:0:5778:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787384324.458150:0:5778:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787384324.458152:0:5778:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787384324.458164:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787384324.458167:0:5778:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787384324.458204:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787384324.458206:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787384324.459420:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787384324.459501:0:7468:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787384324.459539:0:7468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1787384324.460241:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1787384324.460409:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1787384324.460825:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1787384324.461075:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787384324.461078:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787384324.462518:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1787384324.462590:0:7469:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1787384324.462659:0:7469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1787384324.465396:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1787384324.465480:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1787384324.465564:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1787384324.465608:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1787384324.465610:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787384324.467110:0:7470:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1787384324.468288:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1787384324.468566:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1787384324.468656:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1787384324.468674:0:5778:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787384324.468677:0:5778:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787384324.469836:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787384324.470277:0:7471:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787384324.470466:0:7471:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1787384324.470740:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1787384324.470786:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1787384324.470823:0:5778:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 10000000:01000000:1.0:1787384324.471027:0:5778:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787384324.471446:0:5778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471466:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e341676800/0x3522fbed3b6c3181 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c317a expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471475:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e3413fc000/0x3522fbed3b6c31ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c31a4 expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471481:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e341677400/0x3522fbed3b6c31d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c31ce expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471488:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e341676c00/0x3522fbed3b6c31f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c31ea expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471495:0:5778:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c3229 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3222 expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471502:0:5778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471540:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c3229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c3222 expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471556:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c3229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c3222 expref: 16 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.471585:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5778:1874208195884800:0@lo:104: 00000100:00100000:1.0:1787384324.471650:0:5778:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384324.471748:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e341676c00/0x3522fbed3b6c31f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c31ea expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471756:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e341676c00/0x3522fbed3b6c31f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c31ea expref: 16 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.471764:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5af800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5778:1874208195884928:0@lo:104: 00010000:00010000:1.0:1787384324.471790:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e341677400/0x3522fbed3b6c31d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c31ce expref: 16 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471797:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e341677400/0x3522fbed3b6c31d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c31ce expref: 16 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.471804:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5aca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5778:1874208195885056:0@lo:104: 00010000:00010000:1.0:1787384324.471827:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e3413fc000/0x3522fbed3b6c31ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c31a4 expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471834:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e3413fc000/0x3522fbed3b6c31ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c31a4 expref: 16 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.471854:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5778:1874208195885184:0@lo:104: 00010000:00010000:1.0:1787384324.471905:0:5778:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e341676800/0x3522fbed3b6c3181 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c317a expref: 16 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.471913:0:5778:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e341676800/0x3522fbed3b6c3181 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c317a expref: 16 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.471934:0:5778:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5778:1874208195885312:0@lo:104: 00000100:00100000:1.0:1787384324.471966:0:5778:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34316d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384324.472262:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787384324.472280:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.472401:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.472495:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384324.472516:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195884800 00000100:00100000:0.0:1787384324.472524:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195884800 00000100:00100000:0.0:1787384324.472563:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195884928 00000100:00100000:0.0:1787384324.472566:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195884928 00000100:00100000:0.0:1787384324.472577:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195885056 00000100:00100000:0.0:1787384324.472579:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195885056 00000100:00100000:0.0:1787384324.472592:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384324.472600:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3520fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+5:5778:x1874208195884800:12345-0@lo:104: 00010000:00010000:0.0:1787384324.472612:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.472677:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787384324.472684:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3520fd850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+5:5778:x1874208195884800:12345-0@lo:104: Request processed in 85us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.472691:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384324.472736:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384324.472743:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+4:5778:x1874208195884928:12345-0@lo:104: 00010000:00010000:0.0:1787384324.472750:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.472783:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787384324.472788:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+4:5778:x1874208195884928:12345-0@lo:104: Request processed in 48us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.472794:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384324.472805:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787384324.472819:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5778:x1874208195885056:12345-0@lo:104: 00010000:00010000:0.0:1787384324.472827:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.472881:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384324.472885:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:2.0:1787384324.472888:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384324.472889:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5778:x1874208195885056:12345-0@lo:104: Request processed in 72us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.472895:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1787384324.472896:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3429d5400 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:2.0:1787384324.472901:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.472909:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384324.472917:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384324.472924:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384324.473091:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473099:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384324.473123:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473130:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c3222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3229 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473145:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384324.473148:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473152:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677600 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384324.473155:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473161:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384324.473166:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384324.473177:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384324.473191:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473196:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384324.473201:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473207:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e341677600/0x3522fbed3b6c31ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31f1 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473217:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384324.473220:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473225:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676600 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384324.473228:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473234:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384324.473239:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384324.473244:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384324.473255:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473261:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384324.473283:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473290:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c31ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31d5 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473310:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384324.473312:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384324.473314:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384324.473328:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195885696:0@lo:103: 00000100:00100000:0.0:1787384324.473361:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384324.473405:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195885696 00000100:00100000:0.0:1787384324.473409:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195885696 00010000:00010000:0.0:1787384324.473449:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e341677400/0x3522fbed3b6c31d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c31ce expref: 17 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384324.473472:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384324.473477:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:3306:x1874208195885696:12345-0@lo:103: 00010000:00010000:0.0:1787384324.473486:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384324.473491:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e341677400/0x3522fbed3b6c31d5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c31ce expref: 17 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473500:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e341677400/0x3522fbed3b6c31d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c31ce expref: 17 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.473516:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384324.473543:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:3306:x1874208195885696:12345-0@lo:103: Request processed in 66us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.473549:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384324.473582:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195885696:0@lo:103: 00000100:00100000:3.0:1787384324.473885:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.473896:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195885184 00000100:00100000:3.0:1787384324.473899:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195885184 00000100:00100000:3.0:1787384324.473918:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195885312 00000100:00100000:3.0:1787384324.473921:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195885312 00000100:00100000:3.0:1787384324.473931:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787384324.473937:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+4:5778:x1874208195885184:12345-0@lo:104: 00010000:00010000:3.0:1787384324.473956:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474000:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384324.474005:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+4:5778:x1874208195885184:12345-0@lo:104: Request processed in 69us (1510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.474012:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787384324.474025:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787384324.474031:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5778:x1874208195885312:12345-0@lo:104: 00010000:00010000:3.0:1787384324.474039:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c317a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474065:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787384324.474070:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5778:x1874208195885312:12345-0@lo:104: Request processed in 39us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.474075:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787384324.474099:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384324.474103:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474110:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676400 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384324.474113:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474121:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384324.474127:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384324.474132:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384324.474149:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474155:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384324.474167:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474173:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e341676400/0x3522fbed3b6c31a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31ab expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474182:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384324.474185:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c317a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.474188:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195885440:0@lo:103: 00010000:00010000:3.0:1787384324.474191:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fce00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384324.474193:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c317a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.474218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.474240:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384324.474246:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195885568:0@lo:103: 00000100:00100000:1.0:1787384324.474267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.474463:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195885440 00000100:00100000:1.0:1787384324.474468:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195885440 00010000:00010000:1.0:1787384324.474487:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c3229 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3222 expref: 17 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.474502:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195885568 00000100:00100000:1.0:1787384324.474504:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195885568 00010000:00010000:3.0:1787384324.474510:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c317a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.474514:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e341676c00/0x3522fbed3b6c31f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c31ea expref: 18 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384324.474517:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c317a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384324.474523:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:1.0:1787384324.474525:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787384324.474531:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3304:x1874208195885440:12345-0@lo:103: 00010000:00010000:3.0:1787384324.474536:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c317a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.474538:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384324.474542:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384324.474542:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c3229 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3222 expref: 18 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.474551:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c3229 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c3222 expref: 18 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474563:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c317a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.474564:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384324.474570:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c317a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3181 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474582:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384324.474584:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384324.474586:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384324.474586:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3304:x1874208195885440:12345-0@lo:103: Request processed in 56us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.474596:0:5770:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1787384324.474598:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384324.474602:0:5770:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1787384324.474612:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787384324.474618:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:3304:x1874208195885568:12345-0@lo:103: 00010000:00010000:1.0:1787384324.474625:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384324.474629:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e341676c00/0x3522fbed3b6c31f1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c31ea expref: 17 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.474637:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e341676c00/0x3522fbed3b6c31f1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c31ea expref: 17 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.474646:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384324.474668:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:3304:x1874208195885568:12345-0@lo:103: Request processed in 50us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.474673:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384324.474688:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195885824:0@lo:103: 00000100:00100000:1.0:1787384324.474688:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384324.474694:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195885952:0@lo:103: 00000100:00100000:1.0:1787384324.474712:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.474737:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.474753:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195885952 00000100:00100000:1.0:1787384324.474756:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195885952 00010000:00010000:1.0:1787384324.474768:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e341676800/0x3522fbed3b6c3181 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c317a expref: 17 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.474778:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195885824 00000100:00100000:1.0:1787384324.474780:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195885824 00010000:00010000:3.0:1787384324.474787:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384324.474789:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e3413fc000/0x3522fbed3b6c31ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c31a4 expref: 18 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.474799:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787384324.474810:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384324.474811:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3305:x1874208195885952:12345-0@lo:103: 00000100:00100000:3.0:1787384324.474815:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3307:x1874208195885824:12345-0@lo:103: 00010000:00010000:1.0:1787384324.474818:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384324.474821:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384324.474822:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e341676800/0x3522fbed3b6c3181 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c317a expref: 18 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474825:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e3413fc000/0x3522fbed3b6c31ab lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c31a4 expref: 18 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.474831:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e341676800/0x3522fbed3b6c3181 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c317a expref: 18 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.474839:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e3413fc000/0x3522fbed3b6c31ab lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c31a4 expref: 18 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384324.474936:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195885568:0@lo:103: 00000100:00100000:0.0:1787384324.475039:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195885440:0@lo:103: 00010000:00010000:3.0:1787384324.475723:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.475734:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.475750:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.475756:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.475762:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.475768:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.475773:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384324.475777:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.475785:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.475794:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.475817:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384324.475890:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3307:x1874208195885824:12345-0@lo:103: Request processed in 1073us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.475898:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1787384324.476016:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384324.476056:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:3305:x1874208195885952:12345-0@lo:103: Request processed in 1244us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.476062:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384324.476248:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195885824:0@lo:103: 00010000:00010000:1.0:1787384324.476403:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c3229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c3222 expref: 16 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.476460:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ae680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5778:1874208195884800:0@lo:104: 00000100:00100000:2.0:1787384324.476469:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195885952:0@lo:103: 00010000:00010000:1.0:1787384324.476471:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e341676c00/0x3522fbed3b6c31f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c31ea expref: 15 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.476480:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5af800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5778:1874208195884928:0@lo:104: 00010000:00010000:1.0:1787384324.476489:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e341677400/0x3522fbed3b6c31d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c31ce expref: 14 pid: 5777 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.476497:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5aca80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5778:1874208195885056:0@lo:104: 00010000:00010000:1.0:1787384324.476507:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3413fc000/0x3522fbed3b6c31ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c31a4 expref: 13 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.476515:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5778:1874208195885184:0@lo:104: 00010000:00010000:1.0:1787384324.476523:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e341676800/0x3522fbed3b6c3181 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c317a expref: 12 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.476541:0:5778:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac000 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5778:1874208195885312:0@lo:104: 00010000:00010000:1.0:1787384324.476566:0:5778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.476574:0:5778:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.476580:0:5778:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.476585:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340030400/0x3522fbed3b6c323e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787384324.476599:0:5778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1787384324.539710:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:7466:x1874208195884672:12345-0@lo:253: Request processed in 86146us (86873us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.539725:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384324.539966:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195884672:0@lo:253: 10000000:01000000:1.0:1787384324.539982:0:7466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787384324.539986:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787384324.539988:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787384324.539989:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384324.539990:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787384324.539991:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384324.539993:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384324.539994:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787384324.539996:0:7466:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787384324.539997:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384324.539998:0:7466:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787384324.540027:0:7466:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e349e43000 from lustre-OST0001 10000000:01000000:1.0:1787384324.540050:0:7466:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787384324.540052:0:7466:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787384324.540059:0:7466:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e351ef8000 local copy 10000000:01000000:1.0:1787384324.540063:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787384324.540106:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.540114:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.540120:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.540134:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886080:0@lo:101: 00000100:00100000:1.0:1787384324.540161:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.540205:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351265240 going to sleep for 11 seconds 00000100:00100000:3.0:1787384324.540652:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195886080 00000100:00100000:3.0:1787384324.540659:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195886080 00000100:00100000:3.0:1787384324.540703:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787384324.540712:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:7466:x1874208195886080:12345-0@lo:101: 00010000:00010000:3.0:1787384324.540726:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384324.540739:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e3429d4600/0x3522fbed3b6c324c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3245 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.540760:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3429d4600/0x3522fbed3b6c324c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3245 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.540769:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e3429d4600/0x3522fbed3b6c324c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3245 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.540777:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3429d4600, rc 0) 00000100:00100000:3.0:1787384324.540816:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886080:12345-0@lo:101: Request processed in 105us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.540823:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787384324.541069:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886080:0@lo:101: 00010000:00010000:1.0:1787384324.541083:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.541092:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.541197:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886208:0@lo:501: 00000100:00100000:1.0:1787384324.541227:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.541487:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351265240 going to sleep for 11 seconds 00000100:00100000:3.0:1787384324.545229:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195886208 00000100:00100000:3.0:1787384324.545245:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195886208 00000100:00100000:3.0:1787384324.545358:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787384324.545383:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886208:12345-0@lo:501: 00000100:00100000:3.0:1787384324.545696:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886208:12345-0@lo:501: Request processed in 312us (4466us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384324.545704:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787384324.545724:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886208:0@lo:501: 10000000:01000000:2.0:1787384324.545745:0:7466:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787384324.545782:0:7466:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787384324.545790:0:7466:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.545807:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.545814:0:7466:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.545843:0:7466:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787384324.545906:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e349e43000 10000000:01000000:2.0:1787384324.545912:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787384324.545917:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787384324.545920:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384324.545924:0:7466:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787384324.545927:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787384324.545966:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.545974:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.545983:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384324.545999:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886336:0@lo:101: 00000100:00100000:2.0:1787384324.546032:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384324.546077:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384324.546084:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.546092:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030400 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384324.546095:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.546104:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384324.546111:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384324.546117:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384324.546138:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.546144:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384324.546162:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.546168:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340030400/0x3522fbed3b6c3245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x3522fbed3b6c324c expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.546180:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384324.546188:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384324.546190:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384324.546202:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195886464:0@lo:103: 00000100:00100000:0.0:1787384324.546230:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384324.546279:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195886464 00000100:00100000:0.0:1787384324.546283:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195886464 00000100:00100000:0.0:1787384324.546315:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384324.546323:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344263b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:3305:x1874208195886464:12345-0@lo:103: 00010000:00010000:0.0:1787384324.546332:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384324.546344:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3429d4600/0x3522fbed3b6c324c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c3245 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.546360:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384324.546387:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344263b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:3305:x1874208195886464:12345-0@lo:103: Request processed in 65us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.546393:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384324.546433:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195886464:0@lo:103: 00000100:00100000:2.0:1787384324.549635:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffe840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.551424:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195886336 00000100:00100000:1.0:1787384324.551439:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195886336 00000100:00100000:1.0:1787384324.551503:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787384324.551514:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+11:7466:x1874208195886336:12345-0@lo:101: 00010000:00010000:1.0:1787384324.551530:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384324.551550:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c325a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3253 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.551600:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c325a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3253 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.551611:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c325a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3253 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.551737:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030a00, rc 0) 00000100:00100000:1.0:1787384324.552145:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886336:12345-0@lo:101: Request processed in 631us (6110us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.552152:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787384324.552376:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886336:0@lo:101: 00010000:00010000:2.0:1787384324.552405:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.552437:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384324.552551:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886592:0@lo:501: 00000100:00100000:2.0:1787384324.552588:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.552670:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffe840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.552841:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195886592 00000100:00100000:1.0:1787384324.552847:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195886592 00000100:00100000:1.0:1787384324.552908:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787384324.552917:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886592:12345-0@lo:501: 00000100:00100000:1.0:1787384324.553483:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886592:12345-0@lo:501: Request processed in 566us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.553492:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787384324.553612:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886592:0@lo:501: 00000100:00100000:2.0:1787384324.553716:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886720:0@lo:503: 00000100:00100000:2.0:1787384324.553758:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.553772:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffe840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.553823:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195886720 00000100:00100000:1.0:1787384324.553827:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195886720 00000100:00100000:3.0:1787384324.554526:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787384324.554541:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886720:12345-0@lo:503: 00000100:00100000:3.0:1787384324.554793:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886720:12345-0@lo:503: Request processed in 256us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.554800:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787384324.555240:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886720:0@lo:503: 00000040:00080000:2.0:1787384324.555523:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384324.555599:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886848:0@lo:502: 00000100:00100000:2.0:1787384324.555647:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.555682:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffe840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.555707:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195886848 00000100:00100000:1.0:1787384324.555714:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195886848 00000100:00100000:1.0:1787384324.555751:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384324.555759:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886848:12345-0@lo:502: 00000100:00100000:1.0:1787384324.555973:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886848:12345-0@lo:502: Request processed in 215us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.555981:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787384324.556042:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886848:0@lo:502: 00000040:00080000:2.0:1787384324.556362:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787384324.556407:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1787384324.556499:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1787384324.556549:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1787384324.556587:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1787384324.556622:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1787384324.556649:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886976:0@lo:502: 00000100:00100000:2.0:1787384324.556692:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.556774:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffe840 going to sleep for 11 seconds 00000100:00100000:3.0:1787384324.556987:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195886976 00000100:00100000:3.0:1787384324.556993:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195886976 00000100:00100000:3.0:1787384324.557029:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787384324.557038:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886976:12345-0@lo:502: 00000100:00100000:2.0:1787384324.557374:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195886976:0@lo:502: 00000040:00080000:2.0:1787384324.557473:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1787384324.557484:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:3.0:1787384324.557656:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195886976:12345-0@lo:502: Request processed in 158us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.557666:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000020:01000000:3.0:1787384324.558153:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787384324.558162:0:7474:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787384324.558169:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384324.558171:0:7474:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787384324.558178:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384324.558191:0:7474:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff89e3741a4d40) 00000020:00000080:3.0:1787384324.558225:0:7474:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787384324.558232:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787384324.558304:0:7474:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e349e43000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787384324.558313:0:7474:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787384324.558331:0:7474:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3522fbed3b6c3268 00010000:00010000:0.0:1787384324.566917:0:7474:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1787384324.567265:0:7474:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1787384324.572540:0:7474:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1787384324.575070:0:7474:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:0.0:1787384324.588583:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1787384324.590657:0:7474:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1787384324.593313:0:7474:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787384324.593325:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384324.593333:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384324.593335:0:7474:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787384324.593338:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384324.593342:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384324.593349:0:7474:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787384324.593353:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787384324.593354:0:7474:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787384324.594520:0:7474:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384324.594529:0:7474:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384324.594531:0:7474:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787384324.594534:0:7474:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1787384324.596087:0:7466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:1.0:1787384324.596129:0:7466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1787384324.596148:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.596162:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384324.596172:0:7466:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e349e43000 from 1 10000000:01000000:1.0:1787384324.596174:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787384324.596213:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.596222:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.596232:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.596256:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887104:0@lo:101: 00000100:00100000:1.0:1787384324.596325:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.596369:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f76c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384324.596573:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195887104 00000100:00100000:0.0:1787384324.596581:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195887104 00000100:00100000:0.0:1787384324.596640:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787384324.596650:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:7466:x1874208195887104:12345-0@lo:101: 00010000:00010000:0.0:1787384324.596663:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384324.596676:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108b400/0x3522fbed3b6c3276 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c326f expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.596700:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108b400/0x3522fbed3b6c3276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c326f expref: 13 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.596710:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108b400/0x3522fbed3b6c3276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c326f expref: 13 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.596718:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b400, rc 0) 00000100:00100000:0.0:1787384324.596761:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195887104:12345-0@lo:101: Request processed in 113us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.596767:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787384324.599104:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887104:0@lo:101: 00010000:00010000:1.0:1787384324.599129:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.599141:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.599254:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887232:0@lo:501: 00000100:00100000:1.0:1787384324.599324:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.599364:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.599387:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195887232 00000100:00100000:1.0:1787384324.599405:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195887232 00000100:00100000:1.0:1787384324.599460:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787384324.599469:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195887232:12345-0@lo:501: 00000100:00100000:1.0:1787384324.599709:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195887232:12345-0@lo:501: Request processed in 239us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.599717:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787384324.599756:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887232:0@lo:501: 00000100:00100000:1.0:1787384324.599782:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887360:0@lo:503: 00000100:00100000:1.0:1787384324.599816:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.599828:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.599839:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195887360 00000100:00100000:1.0:1787384324.599842:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195887360 00000100:00100000:1.0:1787384324.599900:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787384324.599906:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195887360:12345-0@lo:503: 00000100:00100000:1.0:1787384324.600125:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195887360:12345-0@lo:503: Request processed in 218us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.600131:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787384324.600168:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887360:0@lo:503: 00000040:00080000:1.0:1787384324.600452:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384324.600506:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887488:0@lo:502: 00000100:00100000:1.0:1787384324.600540:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.600555:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.600570:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195887488 00000100:00100000:1.0:1787384324.600580:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195887488 00000100:00100000:1.0:1787384324.600599:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787384324.600606:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195887488:12345-0@lo:502: 00000100:00100000:1.0:1787384324.600747:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195887488:12345-0@lo:502: Request processed in 141us (206us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.600754:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787384324.600791:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887488:0@lo:502: 00000040:00080000:1.0:1787384324.601047:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787384324.601095:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787384324.601118:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887616:0@lo:502: 00000100:00100000:1.0:1787384324.601153:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.601167:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.601180:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195887616 00000100:00100000:1.0:1787384324.601184:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195887616 00000100:00100000:1.0:1787384324.601202:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787384324.601209:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195887616:12345-0@lo:502: 00000100:00100000:1.0:1787384324.601321:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195887616:12345-0@lo:502: Request processed in 112us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.601328:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787384324.601367:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887616:0@lo:502: 00000040:00080000:1.0:1787384324.601457:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787384324.601466:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1787384324.608793:0:7478:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384324.608815:0:7478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384324.608818:0:7478:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787384324.608826:0:7478:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e349e43000 00000020:00000080:3.0:1787384324.608829:0:7478:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384324.609095:0:7478:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384324.609100:0:7478:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384324.609101:0:7478:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1787384324.609104:0:7478:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787384324.609371:0:7466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787384324.609486:0:7466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787384324.609508:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.609538:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384324.609577:0:7466:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787384324.609580:0:7466:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e349e43000 10000000:01000000:1.0:1787384324.609583:0:7466:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e349e43000 10000000:01000000:1.0:1787384324.609587:0:7466:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787384324.609592:0:7466:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e349e43000 from 1 10000000:01000000:1.0:1787384324.609595:0:7466:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787384324.609698:0:7466:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.609707:0:7466:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384324.609724:0:7466:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384324.609748:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887744:0@lo:101: 00000100:00100000:1.0:1787384324.609815:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.611703:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384324.612565:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195887744 00000100:00100000:0.0:1787384324.612577:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195887744 00000100:00100000:3.0:1787384324.612814:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787384324.612825:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195887744:12345-0@lo:101: 00010000:00010000:3.0:1787384324.612840:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384324.612888:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c3284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c327d expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.612916:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c3284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c327d expref: 14 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.612927:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c3284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c327d expref: 14 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.612935:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3429d4e00, rc 0) 00000100:00100000:3.0:1787384324.613165:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7466:x1874208195887744:12345-0@lo:101: Request processed in 341us (3349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.613172:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787384324.613279:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887744:0@lo:101: 00010000:00010000:2.0:1787384324.613295:0:7466:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384324.613305:0:7466:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384324.613437:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887872:0@lo:501: 00000100:00100000:2.0:1787384324.613474:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.613826:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34316da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384324.616184:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195887872 00000100:00100000:1.0:1787384324.616197:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195887872 00000100:00100000:1.0:1787384324.616245:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787384324.616253:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7466:x1874208195887872:12345-0@lo:501: 00000100:00100000:1.0:1787384324.616775:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7466:x1874208195887872:12345-0@lo:501: Request processed in 521us (3298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.616782:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787384324.617142:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195887872:0@lo:501: 00000100:00100000:2.0:1787384324.617192:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195888000:0@lo:503: 00000100:00100000:2.0:1787384324.617239:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.618811:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34316da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384324.619164:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195888000 00000100:00100000:3.0:1787384324.619174:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195888000 00000100:00100000:1.0:1787384324.619334:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787384324.619346:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7466:x1874208195888000:12345-0@lo:503: 00000100:00100000:1.0:1787384324.619765:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7466:x1874208195888000:12345-0@lo:503: Request processed in 420us (2524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384324.619773:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787384324.620287:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195888000:0@lo:503: 00000040:00080000:2.0:1787384324.620724:0:7466:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384324.620800:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195888128:0@lo:502: 00000100:00100000:2.0:1787384324.621245:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.621335:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195888128 00000100:00100000:3.0:1787384324.621341:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195888128 00000100:00100000:3.0:1787384324.621486:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787384324.621497:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7466:x1874208195888128:12345-0@lo:502: 00000100:00100000:3.0:1787384324.621787:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7466:x1874208195888128:12345-0@lo:502: Request processed in 291us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.621796:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787384324.622084:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34316da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384324.622104:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195888128:0@lo:502: 00000040:00080000:2.0:1787384324.622381:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1787384324.622455:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1787384324.622492:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1787384324.622556:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1787384324.622596:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1787384324.622786:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1787384324.622825:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1787384324.622904:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1787384324.623076:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1787384324.623118:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1787384324.623151:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1787384324.623200:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1787384324.623237:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1787384324.623272:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1787384324.623336:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1787384324.623378:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1787384324.623587:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1787384324.623733:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1787384324.623773:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1787384324.623809:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1787384324.624316:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1787384324.624367:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1787384324.624488:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1787384324.624562:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1787384324.624604:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1787384324.624721:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1787384324.624778:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1787384324.624817:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:2.0:1787384324.625152:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1787384324.625209:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:2.0:1787384324.625247:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:2.0:1787384324.625283:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:2.0:1787384324.625322:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:2.0:1787384324.625370:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:2.0:1787384324.625497:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:2.0:1787384324.625551:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:2.0:1787384324.625599:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:2.0:1787384324.625718:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195888256:0@lo:502: 00000100:00100000:2.0:1787384324.625797:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384324.626067:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34316da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384324.626298:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195888256 00000100:00100000:3.0:1787384324.626307:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195888256 00000100:00100000:3.0:1787384324.626364:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787384324.626373:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7466:x1874208195888256:12345-0@lo:502: 00000100:00100000:3.0:1787384324.627121:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7466:x1874208195888256:12345-0@lo:502: Request processed in 746us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.627129:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787384324.627270:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195888256:0@lo:502: 00000040:00080000:2.0:1787384324.627530:0:7466:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:2.0:1787384324.627546:0:7466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787384324.630400:0:7479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787384324.630425:0:7479:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89e37b3e4d40) 00000020:00000080:0.0:1787384324.630446:0:7479:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787384324.630649:0:7479:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e349e43000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787384324.630653:0:7479:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e349e43000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787384324.630656:0:7479:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e349e43000 3 00010000:00080000:0.0:1787384324.630685:0:7479:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e377d8a800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1787384324.642608:0:7479:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787384324.642793:0:7479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787384324.642832:0:7479:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787384324.642846:0:7479:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3522fbed3b6c3292 00000100:00080000:1.0:1787384324.642856:0:7479:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384324.642895:0:7479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e377d8a800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1787384324.642933:0:7479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37c5aca80 x1874208195888384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384324.643476:0:7479:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1787384324.643575:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195888512:0@lo:400: 00000100:00100000:1.0:1787384324.644478:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.644515:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384324.644523:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195888640:0@lo:400: 00000100:00100000:2.0:1787384324.644609:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874208195888384:0@lo:38: 00000100:00100000:0.0:1787384324.645040:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195888512 00000100:00100000:0.0:1787384324.645051:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195888512 00000100:00100000:0.0:1787384324.645101:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384324.645110:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195888512:12345-0@lo:400: 00000100:00100000:0.0:1787384324.645164:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195888512:12345-0@lo:400: Request processed in 54us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.645171:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384324.646110:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195888768:0@lo:400: 00000100:00100000:2.0:1787384324.646261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.646598:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787384324.646734:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5af800 x1874208195888512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384324.646748:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195888512:0@lo:400: 00000100:00100000:1.0:1787384324.646780:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195888768 00000100:00100000:1.0:1787384324.646784:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195888768 00000100:00100000:1.0:1787384324.646843:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384324.646876:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195888768:12345-0@lo:400: 00000100:00100000:1.0:1787384324.646938:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195888768:12345-0@lo:400: Request processed in 80us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384324.647092:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384324.647115:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787384324.647282:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5afb80 x1874208195888768/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384324.647293:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195888768:0@lo:400: 00000100:00080000:3.0:1787384324.647630:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787384324.647936:0:7479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:3.0:1787384324.648152:0:7481:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff89e37273c700 x1874208195888896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384324.648163:0:7481:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34561e6c0 going to sleep for 0 seconds 00000020:01000000:3.0:1787384324.648438:0:7466:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1787384324.648466:0:7466:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384324.648491:0:7466:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.648502:0:7466:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787384324.648555:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787384324.648558:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384324.648559:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384324.648561:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384324.648562:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384324.648563:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384324.648564:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384324.648567:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384324.648573:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384324.648575:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384324.648576:0:7466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384324.648580:0:7466:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1787384324.648583:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384324.648584:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384324.648585:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384324.648586:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384324.648587:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384324.648588:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384324.648589:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384324.648590:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384324.648591:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384324.648592:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384324.648592:0:7466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384324.648609:0:7466:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787384324.648630:0:7466:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195889024:0@lo:253: 00000100:00100000:3.0:1787384324.648696:0:7466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.648733:0:7466:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34561e300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384324.649381:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195889024 00000100:00100000:2.0:1787384324.649398:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195889024 00000100:00100000:2.0:1787384324.649453:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787384324.649462:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7466:x1874208195889024:12345-0@lo:253: 20000000:01000000:2.0:1787384324.649489:0:5777:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787384324.649503:0:5777:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787384324.654889:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195888640 00000100:00100000:0.0:1787384324.654906:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195888640 00000100:00100000:0.0:1787384324.654988:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195888384 00000100:00100000:0.0:1787384324.654992:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195888384 00000100:00100000:0.0:1787384324.655009:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787384324.655019:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195888640:12345-0@lo:400: 00000100:00100000:0.0:1787384324.655112:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195888640:12345-0@lo:400: Request processed in 95us (8513us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.655119:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787384324.655138:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384324.655143:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874208195888384:12345-0@lo:38: 00010000:00080000:0.0:1787384324.655163:0:5785:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 185 last 0 00000020:00000080:0.0:1787384324.655195:0:5785:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3522fbed3b6c3299 00000004:00100000:0.0:1787384324.655210:0:5785:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787384324.655240:0:5785:0:(import.c:65:import_set_state_nolock()) ffff89e377d8e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384324.655280:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874208195888384:12345-0@lo:38: Request processed in 135us (8188us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.655303:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787384324.655353:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5aca80 x1874208195888384/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384334 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384324.655364:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787384324.655372:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787384324.655380:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787384324.655385:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787384324.655387:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e377d8a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1787384324.655570:0:3303:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000f66c08a0): req@ffff89e37273c700 x1874208195888896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384324.655585:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874208195888384:0@lo:38: 00000100:00080000:3.0:1787384324.655782:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384324.655851:0:7481:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.655898:0:7481:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34561e6c0 going to sleep for 11 seconds 00010000:00080000:1.0:1787384324.656175:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c5ae680 x1874208195888640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384340 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384324.656187:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195888640:0@lo:400: 00000100:00100000:0.0:1787384324.656302:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195888896 00000100:00100000:0.0:1787384324.656306:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195888896 00000100:00100000:0.0:1787384324.656354:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384324.656362:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7481:x1874208195888896:12345-0@lo:901: 00000100:00080000:3.0:1787384324.657456:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384324.657558:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7481:x1874208195888896:12345-0@lo:901: Request processed in 1194us (1715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384324.657569:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787384324.657906:0:7481:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37273c700 x1874208195888896/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787384340 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384324.657920:0:7481:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273c700 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7481:1874208195888896:0@lo:901: 20000000:01000000:2.0:1787384324.678365:0:5777:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787384324.678386:0:5777:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1787384324.678537:0:5799:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787384324.678542:0:5799:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787384324.678565:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.678583:0:5799:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e341676200/0x3522fbed3b6c31e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c31dc expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.678592:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.678653:0:5799:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e341676200/0x3522fbed3b6c31e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c31dc expref: 14 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.678667:0:5799:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e341676200/0x3522fbed3b6c31e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c31dc expref: 14 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384324.678681:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1874208195889152:0@lo:104: 00000100:00100000:0.0:1787384324.678743:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384324.678785:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffa540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384324.679057:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195889152 00000100:00100000:3.0:1787384324.679066:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195889152 00000100:00100000:3.0:1787384324.679119:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384324.679129:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5799:x1874208195889152:12345-0@lo:104: 00010000:00010000:3.0:1787384324.679141:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679193:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384324.679200:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:5799:x1874208195889152:12345-0@lo:104: Request processed in 73us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.679207:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787384324.679248:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384324.679254:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679263:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676e00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384324.679266:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679275:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384324.679282:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384324.679287:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384324.679319:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679325:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384324.679343:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679349:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e341676e00/0x3522fbed3b6c31dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c31e3 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679364:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384324.679366:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384324.679367:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384324.679378:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195889280:0@lo:103: 00000100:00100000:3.0:1787384324.679418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384324.679449:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195889280 00000100:00100000:3.0:1787384324.679459:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195889280 00010000:00010000:3.0:1787384324.679476:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e341676200/0x3522fbed3b6c31e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c31dc expref: 15 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384324.679498:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384324.679504:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:3305:x1874208195889280:12345-0@lo:103: 00010000:00010000:3.0:1787384324.679514:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384324.679518:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e341676200/0x3522fbed3b6c31e3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c31dc expref: 15 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679528:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e341676200/0x3522fbed3b6c31e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c31dc expref: 15 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679542:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679550:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787384324.679562:0:5768:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002972232s 00010000:00010000:3.0:1787384324.679566:0:5768:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679572:0:5768:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679579:0:5768:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679584:0:5768:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679598:0:5768:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384324.679603:0:5768:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679610:0:5768:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679618:0:5768:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384324.679628:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384324.679656:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349e11c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:3305:x1874208195889280:12345-0@lo:103: Request processed in 152us (246us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384324.679662:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384324.679722:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195889280:0@lo:103: 00010000:00010000:0.0:1787384324.679892:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e341676200/0x3522fbed3b6c31e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c31dc expref: 14 pid: 5776 timeout: 335 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384324.679903:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5799:1874208195889152:0@lo:104: 00010000:00010000:0.0:1787384324.679916:0:5799:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.679924:0:5799:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.679930:0:5799:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384324.679936:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c32a0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384324.685274:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:7466:x1874208195889024:12345-0@lo:253: Request processed in 35804us (36568us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384324.685289:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787384324.685397:0:7466:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7466:1874208195889024:0@lo:253: 10000000:01000000:3.0:1787384324.685422:0:7466:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787384324.685425:0:7466:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384324.685427:0:7466:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384324.685429:0:7466:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384324.685430:0:7466:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384324.685431:0:7466:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384324.685432:0:7466:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384324.685434:0:7466:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384324.685435:0:7466:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787384324.685437:0:7466:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787384324.685438:0:7466:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384324.685440:0:7466:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787384324.685456:0:7466:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787384324.694455:0:7466:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787384324.694748:0:7466:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787384324.695213:0:7466:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1787384324.695426:0:7466:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787384324.695725:0:7466:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1787384324.696370:0:7466:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787384324.699019:0:7466:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1787384324.934548:0:7466:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787384324.934556:0:7466:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787384324.934588:0:7466:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787384324.934723:0:7466:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787384324.934741:0:7466:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787384324.934775:0:7466:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787384325.134604:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384326.161248:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384326.734004:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384326.734037:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195889408:0@lo:13: 00000100:00100000:2.0:1787384326.734104:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384326.734204:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195889408 00000100:00100000:3.0:1787384326.734212:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195889408 00000100:00100000:3.0:1787384326.734275:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384326.734285:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195889408:12345-0@lo:13: 00002000:00000024:3.0:1787384326.734318:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1787384326.736616:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384326.736756:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195889408:12345-0@lo:13: Request processed in 2467us (2646us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384326.736771:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1787384326.736888:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37273d180 x1874208195889408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384342 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384326.736912:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195889408:0@lo:13: 00010000:00010000:3.0:1787384327.177271:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384328.205592:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384329.238840:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384329.804120:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195889536:0@lo:400: 00000100:00100000:2.0:1787384329.804191:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384329.804236:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195890048:0@lo:400: 00000100:00100000:2.0:1787384329.804260:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384329.804282:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384329.804286:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195889920:0@lo:400: 00000100:00100000:2.0:1787384329.804307:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384329.804331:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195889664:0@lo:400: 00000100:00100000:2.0:1787384329.804351:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384329.804364:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384329.804368:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195889792:0@lo:400: 00000100:00100000:2.0:1787384329.804399:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384329.804432:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195889536 00000100:00100000:2.0:1787384329.804438:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195889536 00000100:00100000:0.0:1787384329.804478:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195890048 00000100:00100000:2.0:1787384329.804480:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787384329.804483:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195890048 00000100:00100000:2.0:1787384329.804488:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:3307:x1874208195889536:12345-0@lo:400: 00000100:00100000:0.0:1787384329.804512:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195889664 00000100:00100000:0.0:1787384329.804515:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195889664 00000100:00100000:2.0:1787384329.804532:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:3307:x1874208195889536:12345-0@lo:400: Request processed in 45us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384329.804533:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195889792 00000100:00100000:0.0:1787384329.804536:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195889792 00000100:00100000:2.0:1787384329.804539:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787384329.804548:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384329.804554:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195890048:12345-0@lo:400: 00000100:00100000:2.0:1787384329.804574:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195889920 00000100:00100000:2.0:1787384329.804578:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195889920 00000100:00100000:0.0:1787384329.804585:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195890048:12345-0@lo:400: Request processed in 32us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384329.804591:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384329.804603:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384329.804603:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384329.804609:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195889920:12345-0@lo:400: 00000100:00100000:0.0:1787384329.804609:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195889664:12345-0@lo:400: 00000100:00100000:2.0:1787384329.804634:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195889920:12345-0@lo:400: Request processed in 26us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384329.804636:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195889664:12345-0@lo:400: Request processed in 29us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384329.804640:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384329.804641:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787384329.804651:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384329.804656:0:5783:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1787384329.804657:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195889792:12345-0@lo:400: 00000100:00100000:0.0:1787384329.804682:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195889792:12345-0@lo:400: Request processed in 25us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384329.804687:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384329.806433:0:5783:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00080000:2.0:1787384329.806464:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384329.806469:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787384329.806580:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c39ca80 x1874208195889792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384329.806595:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195889792:0@lo:400: 00010000:00080000:2.0:1787384329.806606:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c39d180 x1874208195889664/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384329.806613:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195889664:0@lo:400: 00010000:00080000:2.0:1787384329.806649:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c39f480 x1874208195889920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384329.806657:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195889920:0@lo:400: 00000100:00100000:2.0:1787384329.806668:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195889536:0@lo:400: 00010000:00080000:2.0:1787384329.806690:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c39f800 x1874208195890048/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384345 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384329.806697:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195890048:0@lo:400: 00010000:00010000:2.0:1787384330.251769:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384331.275057:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384331.851554:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195890176:0@lo:13: 00000100:00100000:3.0:1787384331.851626:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384331.851698:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195890176 00000100:00100000:3.0:1787384331.851705:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195890176 00000100:00100000:3.0:1787384331.851754:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384331.851762:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195890176:12345-0@lo:13: 00002000:00000024:3.0:1787384331.851794:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384331.851834:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195890176:12345-0@lo:13: Request processed in 72us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384331.851840:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787384331.851874:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787384331.851905:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37273d500 x1874208195890176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384347 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384331.851934:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195890176:0@lo:13: 00000001:02000400:0.0:1787384332.234118:0:7823:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787384332.301551:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787384332.364575:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787384332.364583:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e3450ec800 from 30 10000000:01000000:2.0:1787384332.364590:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787384332.364634:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.364646:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.364656:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384332.364678:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195890304:0@lo:101: 00000100:00100000:2.0:1787384332.364759:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384332.364814:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787384332.364909:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195890304 00000100:00100000:0.0:1787384332.364917:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195890304 00000100:00100000:0.0:1787384332.364974:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787384332.364983:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195890304:12345-0@lo:101: 00010000:00010000:0.0:1787384332.364996:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384332.365008:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c32ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c32a7 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384332.365030:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c32ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c32a7 expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384332.365050:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c32ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c32a7 expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384332.365058:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b200, rc 0) 00000100:00100000:0.0:1787384332.365096:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195890304:12345-0@lo:101: Request processed in 114us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384332.365102:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787384332.368605:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195890304:0@lo:101: 00010000:00010000:2.0:1787384332.368635:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.368648:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384332.368745:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195890432:0@lo:501: 00000100:00100000:2.0:1787384332.368805:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384332.368849:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8240 going to sleep for 11 seconds 00000100:00100000:0.0:1787384332.370319:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195890432 00000100:00100000:0.0:1787384332.370331:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195890432 00000100:00100000:0.0:1787384332.370403:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787384332.370414:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195890432:12345-0@lo:501: 00000100:00100000:0.0:1787384332.371206:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195890432:12345-0@lo:501: Request processed in 792us (2398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384332.371215:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787384332.386267:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195890432:0@lo:501: 00000100:00100000:3.0:1787384332.386428:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195890560:0@lo:503: 00000100:00100000:3.0:1787384332.386510:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384332.386541:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351279d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384332.388202:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195890560 00000100:00100000:2.0:1787384332.388215:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195890560 00000100:00100000:2.0:1787384332.388277:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787384332.388286:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195890560:12345-0@lo:503: 00000100:00100000:2.0:1787384332.388653:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195890560:12345-0@lo:503: Request processed in 367us (2141us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384332.388661:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787384332.389023:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195890560:0@lo:503: 00000100:00100000:3.0:1787384332.389400:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7829:1874208195890688:0@lo:502: 00000100:00100000:3.0:1787384332.389448:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384332.389480:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351279a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384332.390943:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195890688 00000100:00100000:3.0:1787384332.390963:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195890688 00000100:00100000:3.0:1787384332.391023:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787384332.391040:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7829:x1874208195890688:12345-0@lo:502: 00000100:00100000:3.0:1787384332.391613:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7829:x1874208195890688:12345-0@lo:502: Request processed in 578us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384332.391622:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787384332.391683:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7829:1874208195890688:0@lo:502: 00000100:00100000:3.0:1787384332.391746:0:7829:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7829:1874208195890816:0@lo:502: 00000100:00100000:3.0:1787384332.391784:0:7829:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384332.391808:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195890816 00000100:00100000:3.0:1787384332.391812:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195890816 00000100:00100000:3.0:1787384332.391836:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787384332.391843:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7829:x1874208195890816:12345-0@lo:502: 00000100:00100000:3.0:1787384332.395016:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:7829:x1874208195890816:12345-0@lo:502: Request processed in 3163us (3221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384332.395052:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787384332.395154:0:7829:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351279a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384332.396553:0:7829:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7829:1874208195890816:0@lo:502: 00000040:00080000:3.0:1787384332.396598:0:7829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1787384332.396955:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1787384332.396981:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787384332.396991:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.397004:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384332.397014:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787384332.397016:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1787384332.397019:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787384332.397074:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.397082:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.397092:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384332.398646:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195890944:0@lo:101: 00000100:00100000:3.0:1787384332.398714:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384332.398760:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351279a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384332.398811:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195890944 00000100:00100000:2.0:1787384332.398819:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195890944 00000100:00100000:2.0:1787384332.398929:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787384332.398939:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195890944:12345-0@lo:101: 00010000:00010000:2.0:1787384332.398953:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384332.398981:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c32bc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c32b5 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.399006:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c32bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c32b5 expref: 15 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.399016:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c32bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c32b5 expref: 15 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.399024:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd400, rc 0) 00000100:00100000:2.0:1787384332.399114:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195890944:12345-0@lo:101: Request processed in 176us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384332.399120:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787384332.406666:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195890944:0@lo:101: 00010000:00010000:0.0:1787384332.406706:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384332.406720:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384332.406793:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195891072:0@lo:501: 00000100:00100000:0.0:1787384332.406850:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384332.406963:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384332.408464:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195891072 00000100:00100000:3.0:1787384332.408476:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195891072 00000100:00100000:3.0:1787384332.408602:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787384332.408674:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195891072:12345-0@lo:501: 00000100:00100000:3.0:1787384332.409005:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195891072:12345-0@lo:501: Request processed in 333us (2153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384332.409013:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787384332.409801:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195891072:0@lo:501: 00000100:00100000:0.0:1787384332.409846:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195891200:0@lo:503: 00000100:00100000:0.0:1787384332.409916:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384332.409951:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffab40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384332.409980:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195891200 00000100:00100000:3.0:1787384332.409985:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195891200 00000100:00100000:3.0:1787384332.410020:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787384332.410031:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195891200:12345-0@lo:503: 00000100:00100000:3.0:1787384332.410354:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195891200:12345-0@lo:503: Request processed in 325us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384332.410388:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195891200:0@lo:503: 00000100:00100000:3.0:1787384332.410589:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787384332.415370:0:7831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7831:1874208195891328:0@lo:502: 00000100:00100000:1.0:1787384332.415456:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.415500:0:7831:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384332.415548:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195891328 00000100:00100000:3.0:1787384332.415554:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195891328 00000100:00100000:3.0:1787384332.415600:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787384332.415609:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:7831:x1874208195891328:12345-0@lo:502: 00000100:00100000:3.0:1787384332.416365:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:7831:x1874208195891328:12345-0@lo:502: Request processed in 746us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384332.416383:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787384332.416467:0:7831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7831:1874208195891328:0@lo:502: 00000020:01000000:1.0:1787384332.416495:0:7831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384332.416504:0:7831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384332.416506:0:7831:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787384332.416510:0:7831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787384332.416512:0:7831:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1787384332.416530:0:7831:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7831:1874208195891456:0@lo:502: 00000100:00100000:1.0:1787384332.416563:0:7831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.416603:0:7831:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384332.416645:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195891456 00000100:00100000:2.0:1787384332.416650:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195891456 00000100:00100000:2.0:1787384332.416688:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1787384332.416695:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:7831:x1874208195891456:12345-0@lo:502: 00000100:00100000:2.0:1787384332.416911:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:7831:x1874208195891456:12345-0@lo:502: Request processed in 215us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384332.416918:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787384332.417264:0:7831:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410aaa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7831:1874208195891456:0@lo:502: 00000020:01000000:1.0:1787384332.417285:0:7831:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384332.417291:0:7831:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384332.417292:0:7831:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787384332.417296:0:7831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787384332.418924:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787384332.419027:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787384332.419038:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384332.419051:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384332.419062:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787384332.419065:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e348611800 from 30 10000000:01000000:0.0:1787384332.419068:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787384332.419101:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384332.419109:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384332.419120:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384332.419140:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195891584:0@lo:101: 00000100:00100000:0.0:1787384332.420131:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384332.420432:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384332.420487:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195891584 00000100:00100000:1.0:1787384332.420495:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195891584 00000100:00100000:1.0:1787384332.420549:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787384332.420558:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195891584:12345-0@lo:101: 00010000:00010000:1.0:1787384332.420573:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384332.420588:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340031000/0x3522fbed3b6c32ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c32c3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.420612:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340031000/0x3522fbed3b6c32ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c32c3 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.420623:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340031000/0x3522fbed3b6c32ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c32c3 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.420632:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031000, rc 0) 00000100:00100000:1.0:1787384332.420677:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195891584:12345-0@lo:101: Request processed in 121us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384332.420684:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787384332.421037:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195891584:0@lo:101: 00010000:00010000:1.0:1787384332.421053:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.421063:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384332.421134:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195891712:0@lo:501: 00000100:00100000:1.0:1787384332.421165:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.421233:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384332.424925:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195891712 00000100:00100000:0.0:1787384332.425059:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195891712 00000100:00100000:0.0:1787384332.425122:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787384332.425133:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195891712:12345-0@lo:501: 00000100:00100000:0.0:1787384332.425455:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195891712:12345-0@lo:501: Request processed in 323us (4287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384332.425463:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1787384332.425798:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410aaa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195891712:0@lo:501: 00000100:00100000:2.0:1787384332.425845:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195891840:0@lo:503: 00000100:00100000:2.0:1787384332.425909:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384332.425944:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8000 going to sleep for 11 seconds 00000100:00100000:0.0:1787384332.426256:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195891840 00000100:00100000:0.0:1787384332.426260:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195891840 00000100:00100000:0.0:1787384332.426468:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787384332.426477:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195891840:12345-0@lo:503: 00000100:00100000:0.0:1787384332.426665:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195891840:12345-0@lo:503: Request processed in 189us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384332.426672:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787384332.426727:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195891840:0@lo:503: 00000100:00100000:0.0:1787384332.430424:0:7834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344260000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7834:1874208195891968:0@lo:502: 00000100:00100000:0.0:1787384332.430504:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.430544:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195891968 00000100:00100000:0.0:1787384332.430546:0:7834:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384332.430552:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195891968 00000100:00100000:1.0:1787384332.430599:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787384332.430609:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:7834:x1874208195891968:12345-0@lo:502: 00000100:00100000:1.0:1787384332.430837:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:7834:x1874208195891968:12345-0@lo:502: Request processed in 229us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384332.430846:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787384332.431022:0:7834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344260000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7834:1874208195891968:0@lo:502: 00000100:00100000:0.0:1787384332.431066:0:7834:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344260000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7834:1874208195892096:0@lo:502: 00000100:00100000:0.0:1787384332.431091:0:7834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384332.431113:0:7834:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384332.431179:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195892096 00000100:00100000:2.0:1787384332.431193:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195892096 00000100:00100000:2.0:1787384332.431289:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787384332.431297:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:7834:x1874208195892096:12345-0@lo:502: 00000100:00100000:2.0:1787384332.431451:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:7834:x1874208195892096:12345-0@lo:502: Request processed in 154us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384332.431457:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787384332.431831:0:7834:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344260000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7834:1874208195892096:0@lo:502: 00000040:00080000:0.0:1787384332.431852:0:7834:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1787384332.432067:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1787384332.432087:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384332.432098:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.432110:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384332.432119:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787384332.432122:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89e348611800 from 5 10000000:01000000:1.0:1787384332.432124:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787384332.432165:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.432174:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.432203:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384332.432217:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195892224:0@lo:101: 00000100:00100000:1.0:1787384332.432252:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.432283:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787384332.432428:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195892224 00000100:00100000:0.0:1787384332.432433:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195892224 00000100:00100000:0.0:1787384332.432467:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1787384332.432475:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195892224:12345-0@lo:101: 00010000:00010000:0.0:1787384332.432484:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384332.432496:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108ae00/0x3522fbed3b6c32d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c32d1 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384332.432521:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108ae00/0x3522fbed3b6c32d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c32d1 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384332.432530:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108ae00/0x3522fbed3b6c32d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c32d1 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384332.432539:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ae00, rc 0) 00000100:00100000:0.0:1787384332.432569:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195892224:12345-0@lo:101: Request processed in 95us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384332.432575:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787384332.432636:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195892224:0@lo:101: 00010000:00010000:1.0:1787384332.432647:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.432655:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384332.432852:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195892352:0@lo:256: 00000100:00100000:1.0:1787384332.433010:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.433064:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7480 going to sleep for 11 seconds 00000100:00100000:2.0:1787384332.433121:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195892352 00000100:00100000:2.0:1787384332.433125:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195892352 00000100:00100000:2.0:1787384332.433298:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787384332.433305:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195892352:12345-0@lo:256: 20000000:01000000:2.0:1787384332.433319:0:5777:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787384332.433334:0:5777:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787384332.433337:0:5777:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1787384332.433450:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195892352:12345-0@lo:256: Request processed in 144us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384332.433457:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787384332.433514:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195892352:0@lo:256: 10000000:01000000:1.0:1787384332.433555:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787384332.433560:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.433568:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384332.433577:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787384332.433579:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:1.0:1787384332.433585:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787384332.433600:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.433607:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.433614:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384332.433624:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195892480:0@lo:101: 00000100:00100000:1.0:1787384332.433645:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.433657:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787384332.433667:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195892480 00000100:00100000:1.0:1787384332.433669:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195892480 00000100:00100000:1.0:1787384332.433696:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787384332.433702:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195892480:12345-0@lo:101: 00010000:00010000:1.0:1787384332.433707:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384332.433716:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340030000/0x3522fbed3b6c32e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c32df expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.433730:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340030000/0x3522fbed3b6c32e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c32df expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.433739:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340030000/0x3522fbed3b6c32e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c32df expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.433747:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030000, rc 0) 00000100:00100000:1.0:1787384332.433774:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195892480:12345-0@lo:101: Request processed in 72us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384332.433789:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1787384332.433818:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195892480:0@lo:101: 00010000:00010000:1.0:1787384332.433828:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.433835:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384332.433897:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195892608:0@lo:501: 00000100:00100000:1.0:1787384332.433922:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.433939:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787384332.433949:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195892608 00000100:00100000:1.0:1787384332.433952:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195892608 00000100:00100000:1.0:1787384332.433970:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787384332.433975:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195892608:12345-0@lo:501: 00000100:00100000:1.0:1787384332.434410:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195892608:12345-0@lo:501: Request processed in 433us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384332.434417:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1787384332.434446:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195892608:0@lo:501: 00000100:00100000:1.0:1787384332.434468:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195892736:0@lo:503: 00000100:00100000:1.0:1787384332.434502:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.434514:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7480 going to sleep for 11 seconds 00000100:00100000:1.0:1787384332.434525:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195892736 00000100:00100000:1.0:1787384332.434528:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195892736 00000100:00100000:1.0:1787384332.434544:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787384332.434548:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195892736:12345-0@lo:503: 00000100:00100000:1.0:1787384332.435025:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195892736:12345-0@lo:503: Request processed in 473us (520us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384332.435032:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787384332.435075:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195892736:0@lo:503: 00000100:00100000:1.0:1787384332.441007:0:7835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7835:1874208195892864:0@lo:502: 00000100:00100000:1.0:1787384332.441089:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.441127:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195892864 00000100:00100000:1.0:1787384332.441134:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195892864 00000100:00100000:1.0:1787384332.441174:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787384332.441195:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:7835:x1874208195892864:12345-0@lo:502: 00000100:00100000:1.0:1787384332.441515:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:7835:x1874208195892864:12345-0@lo:502: Request processed in 332us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384332.441523:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787384332.441576:0:7835:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384332.441599:0:7835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7835:1874208195892864:0@lo:502: 00000020:01000000:1.0:1787384332.441626:0:7835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787384332.441634:0:7835:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787384332.441641:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384332.441643:0:7835:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787384332.441647:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787384332.441651:0:7835:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:1.0:1787384332.441672:0:7835:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787384332.441676:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384332.441701:0:7835:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89e37b273380) 00000020:00000080:1.0:1787384332.441723:0:7835:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1787384332.441728:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787384332.441790:0:7835:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787384332.441800:0:7835:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787384332.441808:0:7835:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c32f4 00010000:00080000:1.0:1787384332.441837:0:7835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e349e42000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1787384332.442072:0:7835:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1787384332.442407:0:7835:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1787384332.442418:0:7835:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787384332.442938:0:7835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384332.443157:0:7835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384332.443211:0:7835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1787384332.443272:0:7835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:0.0:1787384332.450077:0:7835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384332.450091:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787384332.450121:0:7835:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1787384332.450154:0:7835:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3522fbed3b6c32fb 00000100:00080000:0.0:1787384332.450165:0:7835:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384332.450171:0:7835:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e349e42000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1787384332.450271:0:7835:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e344260000 x1874208195892992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384332.450296:0:7835:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:0.0:1787384332.450368:0:7835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384332.450373:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384332.450375:0:7835:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1787384332.450380:0:7835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384332.450384:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384332.450385:0:7835:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787384332.450388:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787384332.450390:0:7835:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787384332.450417:0:7835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7835:1874208195893248:0@lo:502: 00000100:00100000:3.0:1787384332.450463:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195893120:0@lo:400: 00000100:00100000:2.0:1787384332.450525:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195892992:0@lo:8: 00000100:00100000:3.0:1787384332.450564:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384332.450564:0:7835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.450599:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195893248 00000100:00100000:0.0:1787384332.450602:0:7835:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384332.450606:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384332.450615:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195893632:0@lo:400: 00000100:00100000:1.0:1787384332.450616:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195893248 00000100:00100000:3.0:1787384332.450661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.450703:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1787384332.450704:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195893376:0@lo:400: 00000100:00100000:1.0:1787384332.450724:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:7835:x1874208195893248:12345-0@lo:502: 00000100:00100000:3.0:1787384332.450740:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384332.450763:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384332.450769:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195893504:0@lo:400: 00000100:00100000:3.0:1787384332.450796:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384332.450838:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195893120 00000100:00100000:3.0:1787384332.450845:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195893120 00000100:00100000:3.0:1787384332.451076:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195893632 00000100:00100000:3.0:1787384332.451080:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195893632 00000100:00100000:0.0:1787384332.451083:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195893376 00000100:00100000:0.0:1787384332.451086:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195893376 00000100:00100000:3.0:1787384332.451103:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384332.451112:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195893120:12345-0@lo:400: 00000100:00100000:3.0:1787384332.451249:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195893120:12345-0@lo:400: Request processed in 136us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384332.451616:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:7835:x1874208195893248:12345-0@lo:502: Request processed in 894us (1047us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384332.451627:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000040:00080000:1.0:1787384332.451720:0:7837:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384332.451725:0:7837:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000100:00100000:1.0:1787384332.452165:0:7835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344263800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:7835:1874208195893248:0@lo:502: 00000020:01000000:1.0:1787384332.452205:0:7835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384332.452214:0:7835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384332.452216:0:7835:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1787384332.452222:0:7835:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:1.0:1787384332.452297:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:1.0:1787384332.452323:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1787384332.452337:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.452426:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384332.452450:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1787384332.452453:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89e351ef8000 from 1 10000000:01000000:1.0:1787384332.452457:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787384332.452586:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.452595:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384332.452605:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384332.452626:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195893760:0@lo:101: 00000100:00100000:1.0:1787384332.452678:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.452715:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3507aaa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384332.453164:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384332.453549:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384332.453580:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384332.453614:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787384332.453627:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195893376:12345-0@lo:400: 00000100:00100000:0.0:1787384332.453680:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195893632:12345-0@lo:400: 00000100:00100000:3.0:1787384332.453823:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195893376:12345-0@lo:400: Request processed in 201us (3082us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384332.453830:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787384332.453895:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195893504 00000100:00100000:3.0:1787384332.453915:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195893504 00000100:00100000:3.0:1787384332.453964:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195892992 00000100:00100000:3.0:1787384332.453967:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195892992 00000100:00100000:3.0:1787384332.453982:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384332.453989:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195893504:12345-0@lo:400: 00000100:00100000:3.0:1787384332.454043:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195893504:12345-0@lo:400: Request processed in 41us (3231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384332.454054:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384332.454078:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384332.454085:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874208195892992:12345-0@lo:8: 00010000:00080000:3.0:1787384332.454110:0:6575:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00010000:00080000:1.0:1787384332.454128:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37273df80 x1874208195893504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384332.454147:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195893504:0@lo:400: 00000020:00000080:3.0:1787384332.454152:0:6575:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3522fbed3b6c3309 00010000:00080000:1.0:1787384332.454166:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37273c000 x1874208195893376/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00002000:00100000:3.0:1787384332.454170:0:6575:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89e37b8f1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1787384332.454186:0:6575:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:1.0:1787384332.454191:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195893376:0@lo:400: 00000001:00000004:3.0:1787384332.454192:0:6575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1787384332.454314:0:6575:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1787384332.454665:0:6575:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787384332.454691:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89e37b8f6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384332.454734:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874208195892992:12345-0@lo:8: Request processed in 649us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384332.454741:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787384332.454767:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787384332.454806:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37273d500 x1874208195893120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384332.454821:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195893120:0@lo:400: 00000100:00100000:0.0:1787384332.456300:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195893632:12345-0@lo:400: Request processed in 2618us (5633us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384332.456313:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1787384332.456822:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e344260000 x1874208195892992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384342 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384332.456836:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787384332.456846:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1787384332.456855:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787384332.456890:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1787384332.456896:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e349e42000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787384332.456916:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787384332.456923:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344260000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195892992:0@lo:8: 00000004:00080000:1.0:1787384332.456971:0:7837:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1787384332.456973:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195893760 00000100:00100000:2.0:1787384332.456981:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195893760 00000100:00100000:2.0:1787384332.457033:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787384332.457050:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195893760:12345-0@lo:101: 00010000:00010000:2.0:1787384332.457063:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384332.457082:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e3413fd200/0x3522fbed3b6c3310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3302 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.457109:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3413fd200/0x3522fbed3b6c3310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3302 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.457121:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e3413fd200/0x3522fbed3b6c3310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3302 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787384332.457191:0:7837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 193600329638ns, next at 0ns, rc = 0 00010000:00080000:3.0:1787384332.458546:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37273ca80 x1874208195893632/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384348 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1787384332.458555:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd200, rc 0) 00000100:00100000:3.0:1787384332.458574:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195893632:0@lo:400: 00000100:00100000:2.0:1787384332.458618:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195893760:12345-0@lo:101: Request processed in 1571us (5940us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384332.458627:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787384332.473216:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195893760:0@lo:101: 00010000:00010000:2.0:1787384332.473250:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.473265:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384332.473354:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195893888:0@lo:501: 00000100:00100000:2.0:1787384332.473432:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384332.473480:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195893888 00000100:00100000:2.0:1787384332.473483:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384332.473498:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195893888 00000100:00100000:1.0:1787384332.473569:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787384332.473580:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195893888:12345-0@lo:501: 00000100:00100000:1.0:1787384332.473947:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195893888:12345-0@lo:501: Request processed in 367us (513us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787384332.473956:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787384332.476040:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195893888:0@lo:501: 10000000:01000000:2.0:1787384332.476084:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787384332.476094:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384332.476112:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384332.535504:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1787384332.620480:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195894016:0@lo:13: 00000100:00100000:0.0:1787384332.620570:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1787384332.620645:0:7838:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1787384332.620669:0:7838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1874208195894144:0@lo:7: 00000100:00100000:2.0:1787384332.620701:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384332.620718:0:7838:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384332.623681:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195894016 00000100:00100000:3.0:1787384332.623697:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195894016 00000100:00100000:3.0:1787384332.624604:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384332.624616:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195894016:12345-0@lo:13: 00002000:00000024:3.0:1787384332.624657:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1787384332.624752:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195894016:12345-0@lo:13: Request processed in 138us (4181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384332.624759:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787384332.624813:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384332.625024:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195894144 00000100:00100000:2.0:1787384332.625031:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195894144 00000100:00100000:2.0:1787384332.625069:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384332.625076:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7838:x1874208195894144:12345-0@lo:7: 00010000:00080000:3.0:1787384332.627484:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c39ca80 x1874208195894016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384348 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384332.627514:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195894016:0@lo:13: 00002000:00080000:2.0:1787384332.629400:0:6575:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1787384332.629409:0:6575:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1787384332.629542:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7838:x1874208195894144:12345-0@lo:7: Request processed in 4463us (8836us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384332.629553:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1787384332.629622:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c39e680 x1874208195894144/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787384348 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384332.629636:0:7838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1874208195894144:0@lo:7: 00000004:00080000:3.0:1787384332.629649:0:7838:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:3.0:1787384332.629684:0:7838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1874208195894272:0@lo:5: 00000100:00100000:3.0:1787384332.629715:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384332.629779:0:7838:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344f489c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384332.629811:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195894272 00000100:00100000:2.0:1787384332.629818:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195894272 00000100:00100000:2.0:1787384332.629926:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384332.629935:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7838:x1874208195894272:12345-0@lo:5: 00002000:00080000:2.0:1787384332.629959:0:6576:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1787384332.629963:0:6576:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1787384332.630162:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:7838:x1874208195894272:12345-0@lo:5: Request processed in 226us (444us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1787384332.630169:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1787384332.630219:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37273ca80 x1874208195894272/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384348 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384332.630232:0:7838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273ca80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1874208195894272:0@lo:5: 00000004:00080000:3.0:1787384332.630240:0:7838:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1787384332.630277:0:7838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1874208195894400:0@lo:700: 00000100:00100000:3.0:1787384332.630304:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384332.630321:0:7838:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344f489c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384332.630333:0:6582:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195894400 00000100:00100000:3.0:1787384332.630337:0:6582:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195894400 00000100:00100000:3.0:1787384332.630374:0:6582:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384332.630381:0:6582:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7838:x1874208195894400:12345-0@lo:700: 00000100:00100000:3.0:1787384332.630407:0:6582:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6582:1874208195894528:0@lo:700: 00000100:00100000:3.0:1787384332.630432:0:6582:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384332.630452:0:6582:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344f48540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384332.630473:0:5790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195894528 00000100:00100000:3.0:1787384332.630477:0:5790:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195894528 00000100:00100000:3.0:1787384332.630506:0:5790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384332.630512:0:5790:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6582:x1874208195894528:12345-0@lo:700: 40000000:02000000:1.0:1787384332.665252:0:5790:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1787384332.675327:0:5790:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6582:x1874208195894528:12345-0@lo:700: Request processed in 44803us (44882us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384332.675343:0:5790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787384332.675510:0:6582:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37273c000 x1874208195894528/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787384348 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384332.675528:0:6582:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273c000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6582:1874208195894528:0@lo:700: 40000000:02000000:3.0:1787384332.675543:0:6582:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000100:00100000:1.0:1787384332.794536:0:6582:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7838:x1874208195894400:12345-0@lo:700: Request processed in 164140us (164217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384332.794562:0:6582:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000001:00080000:3.0:1787384332.794658:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1787384332.794673:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:2.0:1787384332.794752:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37273e680 x1874208195894400/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787384348 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384332.794786:0:7838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1874208195894400:0@lo:700: 00000004:02000040:2.0:1787384332.898278:0:7838:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787384332.907272:0:7838:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1874208195894656:0@lo:5: 00000100:00100000:2.0:1787384332.907377:0:7838:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384332.907443:0:7838:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384332.907823:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195894656 00000100:00100000:0.0:1787384332.907834:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195894656 00000100:00100000:0.0:1787384332.907925:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384332.907937:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7838:x1874208195894656:12345-0@lo:5: 00002000:00080000:3.0:1787384332.919033:0:6575:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787384332.919060:0:6575:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1787384332.929274:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7838:x1874208195894656:12345-0@lo:5: Request processed in 21328us (21885us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787384332.929292:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1787384332.929627:0:7838:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c39d500 x1874208195894656/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384348 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384332.929644:0:7838:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1787384332.929663:0:7838:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89e37c39d500 x1874208195894656/t4294967298(4294967298) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787384348 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384332.929677:0:7838:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39d500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7838:1874208195894656:0@lo:5: 00000004:00080000:2.0:1787384332.929694:0:7838:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1787384333.323093:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384334.345309:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384335.371505:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384336.393233:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384336.973404:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195894784:0@lo:13: 00000100:00100000:2.0:1787384336.973501:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384336.973607:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195894784 00000100:00100000:2.0:1787384336.973616:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195894784 00000100:00100000:2.0:1787384336.973688:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384336.973698:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195894784:12345-0@lo:13: 00002000:00000024:2.0:1787384336.973746:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384336.973798:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195894784:12345-0@lo:13: Request processed in 101us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384336.973806:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:2.0:1787384336.973849:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384336.974228:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c39ca80 x1874208195894784/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384352 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384336.974251:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195894784:0@lo:13: 00000001:00080000:3.0:1787384337.346742:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1787384337.418394:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384337.481373:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195894912:0@lo:400: 00000100:00100000:1.0:1787384337.481472:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384337.481529:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195895424:0@lo:400: 00000100:00100000:1.0:1787384337.481567:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384337.481600:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384337.481606:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195895296:0@lo:400: 00000100:00100000:1.0:1787384337.481634:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384337.481673:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195895424 00000100:00100000:1.0:1787384337.481682:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195895424 00000100:00100000:1.0:1787384337.481750:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384337.481762:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195895424:12345-0@lo:400: 00000100:00100000:1.0:1787384337.481827:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195895424:12345-0@lo:400: Request processed in 66us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384337.481835:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1787384337.481915:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787384337.481954:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e2410a9f80 x1874208195895424/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384337.481966:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1787384337.481988:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195895424:0@lo:400: 00000100:00100000:2.0:1787384337.483016:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195895168:0@lo:400: 00000100:00100000:2.0:1787384337.483158:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384337.483201:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384337.483208:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195895040:0@lo:400: 00000100:00100000:2.0:1787384337.483233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384337.484172:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195895296 00000100:00100000:2.0:1787384337.484185:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195895296 00000100:00100000:2.0:1787384337.484383:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195895168 00000100:00100000:2.0:1787384337.484387:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195895168 00000100:00100000:2.0:1787384337.484406:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195895040 00000100:00100000:2.0:1787384337.484409:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195895040 00000100:00100000:2.0:1787384337.484425:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384337.484435:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195895296:12345-0@lo:400: 00000100:00100000:2.0:1787384337.484518:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195895296:12345-0@lo:400: Request processed in 85us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384337.484526:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384337.484541:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787384337.484546:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195895168:12345-0@lo:400: 00000100:00100000:2.0:1787384337.484575:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195895168:12345-0@lo:400: Request processed in 28us (1417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384337.484581:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787384337.484591:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787384337.484596:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195895040:12345-0@lo:400: 00000100:00100000:2.0:1787384337.484632:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195895040:12345-0@lo:400: Request processed in 36us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384337.484639:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787384337.484663:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195894912 00000100:00100000:2.0:1787384337.484667:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195894912 00000100:00100000:2.0:1787384337.484691:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787384337.484699:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3307:x1874208195894912:12345-0@lo:400: 00000100:00100000:2.0:1787384337.484732:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3307:x1874208195894912:12345-0@lo:400: Request processed in 33us (3260us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384337.484738:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:1.0:1787384337.484841:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787384337.484920:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e2410a8a80 x1874208195895296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384337.484937:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195895296:0@lo:400: 00000100:00100000:1.0:1787384337.484949:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195894912:0@lo:400: 00010000:00080000:2.0:1787384337.485573:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e2410abb80 x1874208195895040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384337.485588:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195895040:0@lo:400: 00010000:00080000:2.0:1787384337.485601:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e2410ab480 x1874208195895168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384353 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384337.485611:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195895168:0@lo:400: 00000100:00100000:1.0:1787384337.935641:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384337.935765:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173850752 00000100:00100000:2.0:1787384337.935779:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173850752 00000100:00100000:2.0:1787384337.935838:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 113 00000100:00100000:2.0:1787384337.935848:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2349:x1874208173850752:12345-192.168.203.51@tcp:250: 00010000:00080000:2.0:1787384337.935918:0:5778:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 96efe439-3b25-4671-a225-6795623d17b0@192.168.203.51@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1787384337.935958:0:5778:0:(genops.c:1406:class_connect()) connect: client 96efe439-3b25-4671-a225-6795623d17b0, cookie 0x3522fbed3b6c3317 00000100:00080000:0.0:1787384337.936915:0:5778:0:(import.c:65:import_set_state_nolock()) ffff89e3441a1000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384337.937013:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+5:2349:x1874208173850752:12345-192.168.203.51@tcp:250: Request processed in 1162us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384337.937025:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 113 00000100:00100000:1.0:1787384337.963346:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384337.963553:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173850880 00000100:00100000:0.0:1787384337.963569:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173850880 00000100:00100000:0.0:1787384337.963646:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:0.0:1787384337.963658:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+5:5554:x1874208173850880:12345-192.168.203.51@tcp:101: 00010000:00010000:0.0:1787384337.963679:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384337.963710:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108b000/0x3522fbed3b6c331e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78bd1 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384337.963770:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108b000/0x3522fbed3b6c331e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd1 expref: 6 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384337.963784:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108b000/0x3522fbed3b6c331e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd1 expref: 6 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384337.963795:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b000, rc 0) 00000100:00100000:0.0:1787384337.963918:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+6:5554:x1874208173850880:12345-192.168.203.51@tcp:101: Request processed in 261us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384337.963927:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:0.0:1787384337.975797:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384337.975997:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173851008 00000100:00100000:2.0:1787384337.976012:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173851008 00000100:00100000:2.0:1787384337.976123:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:2.0:1787384337.976146:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+6:5554:x1874208173851008:12345-192.168.203.51@tcp:501: 00000100:00100000:0.0:1787384337.977613:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+6:5554:x1874208173851008:12345-192.168.203.51@tcp:501: Request processed in 1460us (1821us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384337.977629:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:1.0:1787384337.980060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384337.980151:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173851136 00000100:00100000:2.0:1787384337.980162:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173851136 00000100:00100000:2.0:1787384337.980225:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:2.0:1787384337.980236:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+6:5554:x1874208173851136:12345-192.168.203.51@tcp:101: 00010000:00010000:2.0:1787384337.980256:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384337.980277:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e366121000/0x3522fbed3b6c3325 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78bd8 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384337.980310:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e366121000/0x3522fbed3b6c3325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd8 expref: 7 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384337.980332:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e366121000/0x3522fbed3b6c3325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd8 expref: 7 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384337.980342:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121000, rc 0) 00000100:00100000:2.0:1787384337.980416:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+7:5554:x1874208173851136:12345-192.168.203.51@tcp:101: Request processed in 181us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384337.980422:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:2.0:1787384337.986909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384337.986953:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173851264 00000100:00100000:2.0:1787384337.986966:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173851264 00000100:00100000:2.0:1787384337.987023:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 117 00000100:00100000:2.0:1787384337.987033:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+7:5554:x1874208173851264:12345-192.168.203.51@tcp:501: 00000100:00100000:2.0:1787384337.987293:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+8:5554:x1874208173851264:12345-192.168.203.51@tcp:501: Request processed in 260us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384337.987302:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 117 00000100:00100000:3.0:1787384337.993296:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384337.994749:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195895552:0@lo:13: 00000100:00100000:2.0:1787384337.994832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384337.994966:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195895552 00000100:00100000:2.0:1787384337.994975:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195895552 00000100:00100000:2.0:1787384337.995031:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384337.995051:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195895552:12345-0@lo:13: 00002000:00000024:2.0:1787384337.995097:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384337.995149:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195895552:12345-0@lo:13: Request processed in 99us (316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384337.995158:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1787384337.995211:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c39f800 x1874208195895552/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384353 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384337.995231:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195895552:0@lo:13: 00000100:00100000:1.0:1787384337.996138:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173851392 00000100:00100000:1.0:1787384337.996148:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173851392 00000100:00100000:1.0:1787384337.996195:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:1.0:1787384337.996205:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+8:5554:x1874208173851392:12345-192.168.203.51@tcp:503: 00000100:00100000:1.0:1787384337.996635:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+8:5554:x1874208173851392:12345-192.168.203.51@tcp:503: Request processed in 430us (3351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384337.996643:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:2.0:1787384338.005369:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384338.005467:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173851520 00000100:00100000:3.0:1787384338.005480:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173851520 00000100:00100000:3.0:1787384338.005552:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:3.0:1787384338.005565:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+8:5572:x1874208173851520:12345-192.168.203.51@tcp:502: 00000100:00100000:3.0:1787384338.006062:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+8:5572:x1874208173851520:12345-192.168.203.51@tcp:502: Request processed in 497us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384338.006071:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:0.0:1787384338.054568:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384338.056148:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173851648 00000100:00100000:3.0:1787384338.056164:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173851648 00000100:00100000:3.0:1787384338.056230:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:3.0:1787384338.056242:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+8:5572:x1874208173851648:12345-192.168.203.51@tcp:502: 00000100:00100000:3.0:1787384338.056573:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+8:5572:x1874208173851648:12345-192.168.203.51@tcp:502: Request processed in 332us (2019us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384338.056582:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:0.0:1787384338.064974:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384338.066479:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173851776 00000100:00100000:3.0:1787384338.066495:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173851776 00000100:00100000:3.0:1787384338.066583:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:3.0:1787384338.066596:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+8:5554:x1874208173851776:12345-192.168.203.51@tcp:101: 00010000:00010000:3.0:1787384338.066619:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384338.066643:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e3429d4400/0x3522fbed3b6c332c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78c02 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384338.066692:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3429d4400/0x3522fbed3b6c332c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c02 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384338.066706:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e3429d4400/0x3522fbed3b6c332c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c02 expref: 9 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384338.066728:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3429d4400, rc 0) 00000100:00100000:3.0:1787384338.066810:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+9:5554:x1874208173851776:12345-192.168.203.51@tcp:101: Request processed in 217us (1849us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384338.066819:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:1.0:1787384338.079735:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384338.081926:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173851904 00000100:00100000:3.0:1787384338.081946:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173851904 00000100:00100000:3.0:1787384338.082075:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 122 00000100:00100000:3.0:1787384338.082087:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+9:5554:x1874208173851904:12345-192.168.203.51@tcp:256: 20000000:01000000:3.0:1787384338.082122:0:5776:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787384338.082153:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787384338.082157:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787384338.082160:0:5776:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787384338.082162:0:5776:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:3.0:1787384338.087613:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+9:5554:x1874208173851904:12345-192.168.203.51@tcp:256: Request processed in 5511us (7875us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384338.087634:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 122 00000100:00100000:2.0:1787384338.091165:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384338.091308:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173852032 00000100:00100000:3.0:1787384338.091331:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173852032 00000100:00100000:3.0:1787384338.091404:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:3.0:1787384338.091417:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+9:5554:x1874208173852032:12345-192.168.203.51@tcp:101: 00010000:00010000:3.0:1787384338.091441:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384338.091464:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e3429d4c00/0x3522fbed3b6c3333 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78c09 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384338.091501:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3429d4c00/0x3522fbed3b6c3333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c09 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384338.091537:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e3429d4c00/0x3522fbed3b6c3333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c09 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384338.091547:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3429d4c00, rc 0) 00000100:00100000:3.0:1787384338.091617:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:5554:x1874208173852032:12345-192.168.203.51@tcp:101: Request processed in 202us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384338.091625:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:1.0:1787384338.103897:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384338.104434:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173852160 00000100:00100000:0.0:1787384338.104448:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173852160 00000100:00100000:0.0:1787384338.104526:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:0.0:1787384338.104536:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:5554:x1874208173852160:12345-192.168.203.51@tcp:501: 00000100:00100000:0.0:1787384338.104837:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:5554:x1874208173852160:12345-192.168.203.51@tcp:501: Request processed in 298us (981us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384338.104891:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:2.0:1787384338.108098:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384338.108291:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173852288 00000100:00100000:0.0:1787384338.108306:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173852288 00000100:00100000:0.0:1787384338.108388:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:0.0:1787384338.108415:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:5554:x1874208173852288:12345-192.168.203.51@tcp:503: 00000100:00100000:0.0:1787384338.108813:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:5554:x1874208173852288:12345-192.168.203.51@tcp:503: Request processed in 399us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384338.108822:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:2.0:1787384338.117425:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384338.118537:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173852416 00000100:00100000:3.0:1787384338.118554:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173852416 00000100:00100000:3.0:1787384338.118621:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:3.0:1787384338.118633:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:5576:x1874208173852416:12345-192.168.203.51@tcp:502: 00000100:00100000:3.0:1787384338.118998:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:5576:x1874208173852416:12345-192.168.203.51@tcp:502: Request processed in 366us (1584us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384338.119008:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:2.0:1787384338.125255:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384338.127756:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173852544 00000100:00100000:1.0:1787384338.127772:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173852544 00000100:00100000:1.0:1787384338.127837:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 127 00000100:00100000:1.0:1787384338.127849:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:5576:x1874208173852544:12345-192.168.203.51@tcp:502: 00000100:00100000:1.0:1787384338.128926:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:5576:x1874208173852544:12345-192.168.203.51@tcp:502: Request processed in 1073us (3752us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384338.128939:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 127 00000100:00100000:3.0:1787384338.139518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384338.141548:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173852672 00000100:00100000:2.0:1787384338.141564:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173852672 00000100:00100000:2.0:1787384338.141633:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:2.0:1787384338.141643:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2349:x1874208173852672:12345-192.168.203.51@tcp:38: 00010000:00080000:2.0:1787384338.141677:0:5783:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp t0 exp 0000000000000000 cur 199 last 0 00000020:00000080:2.0:1787384338.141733:0:5783:0:(genops.c:1406:class_connect()) connect: client ddc9253f-47aa-4509-981d-645f91ec7250, cookie 0x3522fbed3b6c333a 00000004:00100000:2.0:1787384338.141761:0:5783:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787384338.141767:0:5783:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787384338.246616:0:5783:0:(import.c:65:import_set_state_nolock()) ffff89e3441a7800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384338.246708:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2349:x1874208173852672:12345-192.168.203.51@tcp:38: Request processed in 105064us (107208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384338.246718:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00010000:00010000:2.0:1787384338.441113:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384339.264658:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384339.275996:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173852800 00000100:00100000:3.0:1787384339.276011:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173852800 00000100:00100000:3.0:1787384339.276085:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:3.0:1787384339.276095:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:0:x1874208173852800:12345-192.168.203.51@tcp:41: 00000004:00000024:3.0:1787384339.276137:0:7691:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787384339.276205:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:0:x1874208173852800:12345-192.168.203.51@tcp:41: Request processed in 112us (11557us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384339.276212:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:3.0:1787384339.276274:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384339.276356:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173852928 00000100:00100000:3.0:1787384339.276384:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173852928 00000100:00100000:3.0:1787384339.276405:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:3.0:1787384339.276411:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:5554:x1874208173852928:12345-192.168.203.51@tcp:41: 00000004:00000024:3.0:1787384339.276422:0:5784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1787384339.276447:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:5554:x1874208173852928:12345-192.168.203.51@tcp:41: Request processed in 36us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384339.276453:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00080000:1.0:1787384339.276883:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384339.279453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384339.279664:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173853056 00000100:00100000:0.0:1787384339.279678:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173853056 00000100:00100000:0.0:1787384339.279753:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1787384339.279766:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:5554:x1874208173853056:12345-192.168.203.51@tcp:40: 00000100:00100000:0.0:1787384339.279938:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:5554:x1874208173853056:12345-192.168.203.51@tcp:40: Request processed in 174us (498us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384339.279947:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:2.0:1787384339.289695:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384339.289751:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384339.289779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384339.289826:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384339.289970:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173853440 00000100:00100000:1.0:1787384339.289988:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173853440 00000100:00100000:3.0:1787384339.290093:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173853184 00000100:00100000:3.0:1787384339.290098:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173853184 00000100:00100000:3.0:1787384339.290127:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173853312 00000100:00100000:3.0:1787384339.290130:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173853312 00000100:00100000:3.0:1787384339.290145:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1787384339.290155:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874208173853184:12345-192.168.203.51@tcp:8: 00010000:00080000:3.0:1787384339.290197:0:6575:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1787384339.290234:0:6575:0:(genops.c:1406:class_connect()) connect: client ddc9253f-47aa-4509-981d-645f91ec7250, cookie 0x3522fbed3b6c3341 00002000:00100000:3.0:1787384339.290249:0:6575:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ddc9253f-47aa-4509-981d-645f91ec7250/ffff89e37b8f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787384339.290281:0:6575:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787384339.290702:0:6575:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787384339.290741:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89e37b8f3000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384339.290832:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2349:x1874208173853184:12345-192.168.203.51@tcp:8: Request processed in 677us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384339.290856:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:3.0:1787384339.290924:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:3.0:1787384339.290930:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874208173853312:12345-192.168.203.51@tcp:8: 00010000:00080000:3.0:1787384339.290949:0:6575:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:3.0:1787384339.290985:0:6575:0:(genops.c:1406:class_connect()) connect: client ddc9253f-47aa-4509-981d-645f91ec7250, cookie 0x3522fbed3b6c3348 00002000:00100000:3.0:1787384339.290993:0:6575:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ddc9253f-47aa-4509-981d-645f91ec7250/ffff89e37b8f6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787384339.291001:0:6575:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787384339.291246:0:6575:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787384339.291266:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89e37b8f0800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384339.291294:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2349:x1874208173853312:12345-192.168.203.51@tcp:8: Request processed in 362us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384339.291302:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:3.0:1787384339.291348:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173853568 00000100:00100000:3.0:1787384339.291354:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173853568 00000100:00100000:3.0:1787384339.291393:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 128 00000100:00100000:3.0:1787384339.291401:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:2353:x1874208173853568:12345-192.168.203.51@tcp:400: 00000100:00100000:3.0:1787384339.291429:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:2353:x1874208173853568:12345-192.168.203.51@tcp:400: Request processed in 30us (1603us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384339.291436:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 128 00000100:00100000:1.0:1787384339.298830:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:1.0:1787384339.298972:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:5554:x1874208173853440:12345-192.168.203.51@tcp:33: 00000004:00080000:1.0:1787384339.329213:0:5786:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 30054us 00000004:00200000:1.0:1787384339.344563:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787384339.344801:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:5554:x1874208173853440:12345-192.168.203.51@tcp:33: Request processed in 45843us (55109us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384339.344814:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00010000:00010000:2.0:1787384339.466157:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384339.634395:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384339.634800:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173853696 00000100:00100000:0.0:1787384339.634813:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173853696 00000100:00100000:0.0:1787384339.634954:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1787384339.634966:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:5593:x1874208173853696:12345-192.168.203.51@tcp:101: 00010000:00010000:0.0:1787384339.634993:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384339.635026:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a200/0x3522fbed3b6c334f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78c33 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384339.635321:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108be00/0x3522fbed3b6c3356 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384339.635338:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108be00/0x3522fbed3b6c3356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384339.635421:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108be00/0x3522fbed3b6c3356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384339.638658:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787384339.638673:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384339.638857:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108be00/0x3522fbed3b6c3356 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384339.638931:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a200/0x3522fbed3b6c334f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c33 expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384339.638955:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108be00/0x3522fbed3b6c3356 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c33 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384339.638965:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4100) 00010000:00010000:0.0:1787384339.638968:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384339.638972:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108be00, rc 0) 00000100:00100000:0.0:1787384339.639753:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:5593:x1874208173853696:12345-192.168.203.51@tcp:101: Request processed in 4783us (5370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384339.639765:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00010000:00010000:2.0:1787384340.490042:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384341.513690:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384341.869732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384341.869892:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173853824 00000100:00100000:1.0:1787384341.869905:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173853824 00000100:00100000:1.0:1787384341.869987:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:1.0:1787384341.870003:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:5646:x1874208173853824:12345-192.168.203.51@tcp:41: 00000004:00000024:1.0:1787384341.870050:0:7691:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1787384341.870114:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:5646:x1874208173853824:12345-192.168.203.51@tcp:41: Request processed in 118us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384341.870122:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00080000:2.0:1787384341.870368:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384341.883125:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384341.883236:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173853952 00000100:00100000:2.0:1787384341.883246:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173853952 00000100:00100000:2.0:1787384341.883339:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1787384341.883350:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ddc9253f-47aa-4509-981d-645f91ec7250+6:5646:x1874208173853952:12345-192.168.203.51@tcp:13: 00002000:00000024:2.0:1787384341.883391:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384341.883458:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ddc9253f-47aa-4509-981d-645f91ec7250+6:5646:x1874208173853952:12345-192.168.203.51@tcp:13: Request processed in 111us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384341.883466:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00080000:1.0:1787384341.887961:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384341.888127:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384341.888194:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173854080 00000100:00100000:2.0:1787384341.888204:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173854080 00000100:00100000:2.0:1787384341.888276:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:2.0:1787384341.888286:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ddc9253f-47aa-4509-981d-645f91ec7250+6:5646:x1874208173854080:12345-192.168.203.51@tcp:13: 00002000:00000024:2.0:1787384341.888560:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384341.888682:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:ddc9253f-47aa-4509-981d-645f91ec7250+6:5646:x1874208173854080:12345-192.168.203.51@tcp:13: Request processed in 396us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384341.888690:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00080000:1.0:1787384341.888709:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384342.089337:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195895680:0@lo:13: 00000100:00100000:0.0:1787384342.089410:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384342.089655:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195895680 00000100:00100000:2.0:1787384342.089662:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195895680 00000100:00100000:2.0:1787384342.089713:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384342.089720:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344260000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195895680:12345-0@lo:13: 00002000:00000024:2.0:1787384342.089738:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384342.089777:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344260000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195895680:12345-0@lo:13: Request processed in 58us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384342.089784:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787384342.089814:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2bfb80 x1874208195895680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384358 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384342.089831:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195895680:0@lo:13: 00000100:00080000:1.0:1787384342.089880:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787384342.537134:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384342.602016:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195895808:0@lo:400: 00000100:00100000:1.0:1787384342.602097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384342.602152:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195896320:0@lo:400: 00000100:00100000:1.0:1787384342.602173:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384342.602195:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384342.602199:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195895936:0@lo:400: 00000100:00100000:1.0:1787384342.602218:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384342.602240:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195896192:0@lo:400: 00000100:00100000:1.0:1787384342.602267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384342.602302:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384342.602308:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195896064:0@lo:400: 00000100:00100000:1.0:1787384342.602331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384342.602362:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195895936 00000100:00100000:1.0:1787384342.602371:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195895936 00000100:00100000:1.0:1787384342.602427:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195896192 00000100:00100000:1.0:1787384342.602430:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195896192 00000100:00100000:1.0:1787384342.602458:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195896064 00000100:00100000:1.0:1787384342.602461:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195896064 00000100:00100000:1.0:1787384342.602478:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384342.602487:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195895936:12345-0@lo:400: 00000100:00100000:0.0:1787384342.602538:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384342.602549:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195896192:12345-0@lo:400: 00000100:00100000:0.0:1787384342.602603:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195896192:12345-0@lo:400: Request processed in 55us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384342.602625:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384342.602648:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787384342.602654:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195896064:12345-0@lo:400: 00000100:00100000:0.0:1787384342.602684:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195896064:12345-0@lo:400: Request processed in 30us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384342.602690:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787384342.602712:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195896320 00000100:00100000:0.0:1787384342.602716:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195896320 00000100:00100000:0.0:1787384342.602746:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384342.602752:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195896320:12345-0@lo:400: 00000100:00100000:0.0:1787384342.602786:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195896320:12345-0@lo:400: Request processed in 35us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384342.602792:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1787384342.602817:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384342.602822:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384342.602885:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195896064:0@lo:400: 00000100:00100000:0.0:1787384342.602900:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195896192:0@lo:400: 00010000:00080000:0.0:1787384342.602939:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e2410a9180 x1874208195896320/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384358 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384342.602951:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195896320:0@lo:400: 00000100:00100000:1.0:1787384342.603280:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195895936:12345-0@lo:400: Request processed in 792us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384342.603299:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384342.603412:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195895936:0@lo:400: 00000100:00100000:3.0:1787384342.603959:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195895808 00000100:00100000:3.0:1787384342.603968:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195895808 00000100:00100000:3.0:1787384342.604178:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787384342.604190:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195895808:12345-0@lo:400: 00000100:00100000:3.0:1787384342.604275:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195895808:12345-0@lo:400: Request processed in 88us (2177us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384342.604283:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1787384342.605838:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195895808:0@lo:400: 00000100:00100000:3.0:1787384343.116343:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384343.116367:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195896448:0@lo:13: 00000100:00100000:3.0:1787384343.116440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384343.116498:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195896448 00000100:00100000:3.0:1787384343.116507:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195896448 00000100:00100000:3.0:1787384343.116592:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384343.116600:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195896448:12345-0@lo:13: 00002000:00000024:3.0:1787384343.116621:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384343.116662:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195896448:12345-0@lo:13: Request processed in 62us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384343.116669:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1787384343.116764:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37275c000 x1874208195896448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384359 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384343.116779:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195896448:0@lo:13: 00010000:00010000:2.0:1787384343.561121:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787384343.704342:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000001:00100000:2.0:1787384343.704980:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000001:00100000:1.0:1787384344.229930:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00010000:00010000:3.0:1787384344.585594:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787384344.698461:0:8140:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1787384344.744489:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384344.744539:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384344.744575:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384344.744605:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384344.744638:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173854336 00000100:00100000:3.0:1787384344.744649:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173854336 00000100:00100000:2.0:1787384344.744681:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173854464 00000100:00100000:2.0:1787384344.744685:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173854464 00000100:00100000:2.0:1787384344.744722:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173854592 00000100:00100000:2.0:1787384344.744724:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173854592 00000100:00100000:3.0:1787384344.744727:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:3.0:1787384344.744738:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173854336:12345-192.168.203.51@tcp:400: 00000100:00100000:2.0:1787384344.744741:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:2.0:1787384344.744747:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173854464:12345-192.168.203.51@tcp:400: 00000100:00100000:1.0:1787384344.744829:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173854208 00000100:00100000:1.0:1787384344.744834:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173854208 00000100:00100000:1.0:1787384344.744891:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00100000:1.0:1787384344.744908:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173854208:12345-192.168.203.51@tcp:400: 00000100:00100000:2.0:1787384344.744997:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173854464:12345-192.168.203.51@tcp:400: Request processed in 248us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.745005:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:2.0:1787384344.745026:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1787384344.745033:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173854592:12345-192.168.203.51@tcp:400: 00000100:00080000:0.0:1787384344.745350:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384344.745355:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787384344.745358:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384344.746642:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173854336:12345-192.168.203.51@tcp:400: Request processed in 1894us (2054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384344.746658:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:1.0:1787384344.747742:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173854208:12345-192.168.203.51@tcp:400: Request processed in 2827us (3260us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384344.747757:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00100000:2.0:1787384344.748220:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173854592:12345-192.168.203.51@tcp:400: Request processed in 3184us (3609us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384344.748250:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00010000:00010000:2.0:1787384345.614565:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384346.642348:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384347.214408:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195896576:0@lo:13: 00000100:00100000:0.0:1787384347.214496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384347.214790:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195896576 00000100:00100000:3.0:1787384347.214799:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195896576 00000100:00100000:3.0:1787384347.214896:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384347.214906:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195896576:12345-0@lo:13: 00002000:00000024:3.0:1787384347.214942:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384347.214995:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344263800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195896576:12345-0@lo:13: Request processed in 90us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384347.215001:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1787384347.215050:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37275ce00 x1874208195896576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384363 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384347.215070:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195896576:0@lo:13: 00000100:00080000:0.0:1787384347.215077:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787384347.657583:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384347.722742:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195896704:0@lo:400: 00000100:00100000:0.0:1787384347.722789:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195896832:0@lo:400: 00000100:00100000:1.0:1787384347.722826:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384347.722835:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384347.722890:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195897216:0@lo:400: 00000100:00100000:0.0:1787384347.722911:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384347.722912:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384347.722922:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195896960:0@lo:400: 00000100:00100000:1.0:1787384347.722931:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384347.722937:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195897088:0@lo:400: 00000100:00100000:0.0:1787384347.722955:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384347.722993:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195896704 00000100:00100000:0.0:1787384347.723001:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195896704 00000100:00100000:0.0:1787384347.723050:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787384347.723058:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195896704:12345-0@lo:400: 00000100:00100000:0.0:1787384347.723104:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195896704:12345-0@lo:400: Request processed in 47us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384347.723112:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787384347.723145:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195896832 00000100:00100000:0.0:1787384347.723149:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195896832 00000100:00100000:0.0:1787384347.723171:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195896960 00000100:00100000:0.0:1787384347.723175:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195896960 00000100:00100000:0.0:1787384347.723201:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384347.723207:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195896832:12345-0@lo:400: 00000100:00100000:0.0:1787384347.723243:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195896832:12345-0@lo:400: Request processed in 36us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384347.723250:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787384347.723274:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384347.723282:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195896960:12345-0@lo:400: 00000100:00100000:1.0:1787384347.723315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384347.723323:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195896960:12345-0@lo:400: Request processed in 41us (367us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384347.723340:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787384347.723347:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195896704:0@lo:400: 00000100:00100000:0.0:1787384347.723354:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195897088 00000100:00100000:0.0:1787384347.723359:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195897088 00000100:00100000:0.0:1787384347.723382:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787384347.723388:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195897088:12345-0@lo:400: 00000100:00100000:0.0:1787384347.723420:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195897088:12345-0@lo:400: Request processed in 32us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384347.723426:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787384347.723443:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195897216 00000100:00100000:0.0:1787384347.723445:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195897216 00000100:00100000:0.0:1787384347.723470:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384347.723477:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195897216:12345-0@lo:400: 00000100:00100000:0.0:1787384347.723508:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195897216:12345-0@lo:400: Request processed in 31us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384347.723515:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384347.723689:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195897088:0@lo:400: 00010000:00080000:1.0:1787384347.723711:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e3460e0e00 x1874208195897216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384363 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384347.723721:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195897216:0@lo:400: 00000100:00080000:1.0:1787384347.724359:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384347.724366:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384347.724396:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195896960:0@lo:400: 00000100:00100000:1.0:1787384347.724408:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195896832:0@lo:400: 00000100:00100000:2.0:1787384348.234001:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384348.234023:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195897344:0@lo:13: 00000100:00100000:2.0:1787384348.234086:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384348.234228:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195897344 00000100:00100000:3.0:1787384348.234235:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195897344 00000100:00100000:3.0:1787384348.234292:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384348.234301:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195897344:12345-0@lo:13: 00002000:00000024:3.0:1787384348.234332:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384348.234372:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195897344:12345-0@lo:13: Request processed in 72us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384348.234378:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787384348.234445:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37275f800 x1874208195897344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384364 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384348.234463:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195897344:0@lo:13: 00000020:00000080:2.0:1787384348.250572:0:8287:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffef12d1100 00000020:00000080:2.0:1787384348.250589:0:8287:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:2.0:1787384348.250594:0:8287:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:2.0:1787384348.250601:0:8287:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef12d3390 20000000:00000080:2.0:1787384348.250607:0:8287:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e379ea6400 uarg=0000000000000000 20000000:01000000:2.0:1787384348.250643:0:8287:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1787384348.250645:0:8287:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1787384348.250648:0:8287:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787384348.250654:0:8287:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1787384348.250658:0:8287:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1787384348.250670:0:8287:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787384348.250673:0:8287:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787384348.250848:0:8287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787384348.250851:0:8287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787384348.252091:0:8288:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1787384348.252648:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1787384348.252713:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1787384348.252747:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:0.0:1787384348.252762:0:8287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1787384348.252764:0:8287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787384348.253679:0:8289:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1787384348.254280:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1787384348.254325:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1787384348.254373:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1787384348.254387:0:8287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1787384348.254389:0:8287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787384348.255232:0:8290:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1787384348.255586:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1787384348.255642:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1787384348.255679:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1787384348.255693:0:8287:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1787384348.255701:0:8287:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787384348.256666:0:8291:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1787384348.257241:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1787384348.257298:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1787384348.257333:0:8287:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:0.0:1787384348.257349:0:8287:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1787384348.257368:0:8287:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257385:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c325a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3253 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257394:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c3284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c327d expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257403:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c32ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c32a7 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257410:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c32bc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c32b5 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257416:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e340031000/0x3522fbed3b6c32ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c32c3 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257423:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e340030000/0x3522fbed3b6c32e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c32df expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257430:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e3413fd200/0x3522fbed3b6c3310 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3302 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257441:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e35108b000/0x3522fbed3b6c331e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd1 expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257462:0:8287:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e366121000/0x3522fbed3b6c3325 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd8 expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257470:0:8287:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257509:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e366121000/0x3522fbed3b6c3325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd8 expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257523:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e366121000/0x3522fbed3b6c3325 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd8 expref: 9 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.257539:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195897472:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384348.257667:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e35108b000/0x3522fbed3b6c331e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd1 expref: 9 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257676:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e35108b000/0x3522fbed3b6c331e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd1 expref: 9 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.257686:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195897600:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384348.257714:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e3413fd200/0x3522fbed3b6c3310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c3302 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257722:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e3413fd200/0x3522fbed3b6c3310 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c3302 expref: 18 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.257731:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195897728:0@lo:104: 00000100:00100000:0.0:1787384348.257767:0:8287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384348.257814:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e340030000/0x3522fbed3b6c32e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c32df expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257823:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e340030000/0x3522fbed3b6c32e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c32df expref: 18 pid: 5776 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.257831:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195897856:0@lo:104: 00000100:00100000:0.0:1787384348.257852:0:8287:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384348.257963:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e340031000/0x3522fbed3b6c32ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c32c3 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.257971:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e340031000/0x3522fbed3b6c32ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c32c3 expref: 18 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.257979:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195897984:0@lo:104: 00010000:00010000:0.0:1787384348.257999:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c32bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c32b5 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.258006:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c32bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c32b5 expref: 18 pid: 5776 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.258013:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195898112:0@lo:104: 00010000:00010000:0.0:1787384348.258032:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c32ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c32a7 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.258039:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c32ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c32a7 expref: 18 pid: 5777 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.258046:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195898240:0@lo:104: 00010000:00010000:0.0:1787384348.258062:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c3284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c327d expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.258075:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c3284 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c327d expref: 18 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.258082:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195898368:0@lo:104: 00010000:00010000:0.0:1787384348.258102:0:8287:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c325a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c3253 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.258109:0:8287:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c325a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c3253 expref: 18 pid: 5777 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.258186:0:8287:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195898496:0@lo:104: 00000100:00100000:0.0:1787384348.258205:0:8287:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384348.258724:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787384348.258743:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384348.258755:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384348.258764:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384348.258772:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384348.258780:0:5767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384348.258787:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195897728 00000100:00100000:1.0:1787384348.258794:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195897728 00000100:00100000:1.0:1787384348.258840:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195897856 00000100:00100000:1.0:1787384348.258843:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195897856 00000100:00100000:1.0:1787384348.258854:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195897984 00000100:00100000:1.0:1787384348.258856:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195897984 00000100:00100000:1.0:1787384348.258929:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195898112 00000100:00100000:1.0:1787384348.258932:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195898112 00000100:00100000:1.0:1787384348.258940:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195898240 00000100:00100000:1.0:1787384348.258942:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195898240 00000100:00100000:1.0:1787384348.258950:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195898368 00000100:00100000:1.0:1787384348.258952:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195898368 00000100:00100000:1.0:1787384348.258961:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195898496 00000100:00100000:1.0:1787384348.258964:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195898496 00000100:00100000:1.0:1787384348.258975:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384348.258983:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:8287:x1874208195897728:12345-0@lo:104: 00010000:00010000:1.0:1787384348.258994:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259094:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384348.259101:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+9:8287:x1874208195897728:12345-0@lo:104: Request processed in 119us (1333us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384348.259108:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:3.0:1787384348.259184:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384348.259191:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.259199:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031800 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384348.259204:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.259212:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384348.259220:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384348.259235:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384348.259275:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.259283:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384348.259300:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.259308:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c3302 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3310 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.259319:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384348.259321:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384348.259323:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384348.259334:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195898624:0@lo:103: 00000100:00100000:3.0:1787384348.259362:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384348.259432:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384348.259441:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b980450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+8:8287:x1874208195897856:12345-0@lo:104: 00010000:00010000:1.0:1787384348.259454:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259494:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384348.259500:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b980450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+8:8287:x1874208195897856:12345-0@lo:104: Request processed in 61us (1647us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384348.259507:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384348.259537:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787384348.259545:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+7:8287:x1874208195897984:12345-0@lo:104: 00010000:00010000:1.0:1787384348.259551:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259579:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787384348.259585:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+7:8287:x1874208195897984:12345-0@lo:104: Request processed in 42us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384348.259590:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787384348.259601:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384348.259607:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+6:8287:x1874208195898112:12345-0@lo:104: 00010000:00010000:1.0:1787384348.259614:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259637:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787384348.259642:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+6:8287:x1874208195898112:12345-0@lo:104: Request processed in 36us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384348.259647:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787384348.259658:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384348.259663:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+5:8287:x1874208195898240:12345-0@lo:104: 00010000:00010000:1.0:1787384348.259676:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259700:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1787384348.259705:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+5:8287:x1874208195898240:12345-0@lo:104: Request processed in 42us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384348.259711:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384348.259722:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384348.259728:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+4:8287:x1874208195898368:12345-0@lo:104: 00010000:00010000:1.0:1787384348.259734:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259755:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1787384348.259760:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410aad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+4:8287:x1874208195898368:12345-0@lo:104: Request processed in 33us (988us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384348.259765:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384348.259775:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384348.259781:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:8287:x1874208195898496:12345-0@lo:104: 00010000:00010000:1.0:1787384348.259788:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259809:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1787384348.259814:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:8287:x1874208195898496:12345-0@lo:104: Request processed in 34us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384348.259819:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1787384348.259836:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1787384348.259840:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259852:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030200 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:1.0:1787384348.259856:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259888:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384348.259895:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384348.259901:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787384348.259915:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259921:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384348.259935:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259942:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c32df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32e6 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259954:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1787384348.259958:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259964:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ac00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:1.0:1787384348.259967:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.259984:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384348.259991:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384348.259997:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787384348.260008:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.260014:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384348.260019:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.260026:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e35108ac00/0x3522fbed3b6c32c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32ca expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.260035:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1787384348.260038:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.260044:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fce00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:1.0:1787384348.260047:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.260054:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384348.260061:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384348.260071:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787384348.260083:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.260089:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384348.260098:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.260106:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3413fce00/0x3522fbed3b6c32b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32bc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260204:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787384348.260341:0:8292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384348.260347:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260354:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fc000 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384348.260357:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260365:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384348.260373:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384348.260384:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384348.260398:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260404:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384348.260409:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260416:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3413fc000/0x3522fbed3b6c32a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c32ae expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260427:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384348.260430:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260436:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fdc00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384348.260439:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260446:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384348.260453:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384348.260459:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384348.260469:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260475:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384348.260483:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260490:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3413fdc00/0x3522fbed3b6c3253 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c325a expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260499:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384348.260501:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384348.260503:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384348.260568:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384348.260572:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260579:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031200 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384348.260583:0:8292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260590:0:8292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384348.260597:0:8292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384348.260603:0:8292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384348.260615:0:8292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260621:0:8292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384348.260625:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260632:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340031200/0x3522fbed3b6c327d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3284 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.260645:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384348.260647:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384348.260649:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384348.260653:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384348.260655:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384348.261020:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384348.261021:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384348.261023:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384348.261036:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195898752:0@lo:103: 00000100:00100000:1.0:1787384348.261071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384348.261099:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195899264:0@lo:103: 00000100:00100000:3.0:1787384348.261228:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195898624 00000100:00100000:3.0:1787384348.261234:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195898624 00010000:00010000:3.0:1787384348.261267:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e3413fd200/0x3522fbed3b6c3310 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3302 expref: 19 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384348.261290:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195898752 00000100:00100000:3.0:1787384348.261293:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195898752 00010000:00010000:3.0:1787384348.261303:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e340030000/0x3522fbed3b6c32e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c32df expref: 20 pid: 5776 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384348.261321:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384348.261327:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+20:3307:x1874208195898624:12345-0@lo:103: 00010000:00010000:3.0:1787384348.261336:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384348.261341:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e3413fd200/0x3522fbed3b6c3310 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3302 expref: 20 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.261351:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e3413fd200/0x3522fbed3b6c3310 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c3302 expref: 20 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.261367:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384348.261389:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+20:3307:x1874208195898624:12345-0@lo:103: Request processed in 63us (2027us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384348.261396:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384348.261408:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384348.261420:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195898752:12345-0@lo:103: 00010000:00010000:3.0:1787384348.261427:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384348.261431:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e340030000/0x3522fbed3b6c32e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c32df expref: 19 pid: 5776 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.261440:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e340030000/0x3522fbed3b6c32e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c32df expref: 19 pid: 5776 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.261449:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384348.261467:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195898752:12345-0@lo:103: Request processed in 47us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384348.261473:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384348.261519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384348.261580:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195898752:0@lo:103: 00000100:00100000:1.0:1787384348.261594:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787384348.261600:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195898880:0@lo:103: 00000100:00100000:1.0:1787384348.261619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1787384348.261768:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3413fd200/0x3522fbed3b6c3310 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c3302 expref: 18 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.261789:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195897728:0@lo:104: 00000100:00100000:1.0:1787384348.262108:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195899392:0@lo:103: 00000100:00100000:1.0:1787384348.262226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384348.262242:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195899264 00000100:00100000:3.0:1787384348.262246:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195899264 00010000:00010000:3.0:1787384348.262274:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c325a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3253 expref: 18 pid: 5777 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384348.262289:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195898880 00000100:00100000:3.0:1787384348.262291:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195898880 00010000:00010000:3.0:1787384348.262300:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e340031000/0x3522fbed3b6c32ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c32c3 expref: 19 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384348.262311:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384348.262317:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195899264:12345-0@lo:103: 00010000:00010000:3.0:1787384348.262324:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384348.262329:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c325a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3253 expref: 19 pid: 5777 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.262338:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c325a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c3253 expref: 19 pid: 5777 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.262363:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384348.262386:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195899264:12345-0@lo:103: Request processed in 69us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384348.262393:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384348.262405:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384348.262410:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3304:x1874208195898880:12345-0@lo:103: 00010000:00010000:3.0:1787384348.262417:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384348.262422:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e340031000/0x3522fbed3b6c32ca lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c32c3 expref: 18 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.262430:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e340031000/0x3522fbed3b6c32ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c32c3 expref: 18 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.262439:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384348.262457:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3304:x1874208195898880:12345-0@lo:103: Request processed in 46us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384348.262463:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1787384348.262535:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340030000/0x3522fbed3b6c32e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c32df expref: 17 pid: 5776 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.262547:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195897856:0@lo:104: 00010000:00010000:0.0:1787384348.262556:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340031000/0x3522fbed3b6c32ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c32c3 expref: 16 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.262564:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195897984:0@lo:104: 00000100:00100000:0.0:1787384348.262571:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195898112:0@lo:104: 00000100:00100000:0.0:1787384348.262579:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e3480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195898240:0@lo:104: 00000100:00100000:0.0:1787384348.262587:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195898368:0@lo:104: 00010000:00010000:0.0:1787384348.262603:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c325a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c3253 expref: 15 pid: 5777 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384348.262610:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195898496:0@lo:104: 00000100:00100000:0.0:1787384348.262621:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195897472:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384348.262629:0:8287:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8287:1874208195897600:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384348.262659:0:8287:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384348.262761:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195899264:0@lo:103: 00000100:00100000:1.0:1787384348.262774:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195898880:0@lo:103: 00000100:00100000:1.0:1787384348.262892:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195899008:0@lo:103: 00000100:00100000:1.0:1787384348.262918:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384348.263079:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195899136:0@lo:103: 00000100:00100000:2.0:1787384348.263419:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384348.263546:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195899392 00000100:00100000:3.0:1787384348.263552:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195899392 00010000:00010000:3.0:1787384348.263573:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c3284 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c327d expref: 15 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384348.263594:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195899008 00000100:00100000:3.0:1787384348.263597:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195899008 00010000:00010000:3.0:1787384348.263607:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c32bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c32b5 expref: 16 pid: 5776 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384348.263623:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384348.263629:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3304:x1874208195899392:12345-0@lo:103: 00010000:00010000:3.0:1787384348.263646:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384348.263651:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c3284 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c327d expref: 16 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.263661:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c3284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c327d expref: 16 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.263674:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c3284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c327d expref: 16 pid: 5778 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.263686:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384348.263716:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:3304:x1874208195899392:12345-0@lo:103: Request processed in 86us (1490us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384348.263723:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384348.263736:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384348.263742:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:3306:x1874208195899008:12345-0@lo:103: 00010000:00010000:3.0:1787384348.263749:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384348.263754:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c32bc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c32b5 expref: 14 pid: 5776 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.263762:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c32bc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c32b5 expref: 14 pid: 5776 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.263772:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c32bc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c32b5 expref: 14 pid: 5776 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.263781:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384348.263813:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:3306:x1874208195899008:12345-0@lo:103: Request processed in 71us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384348.263819:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787384348.264011:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384348.264349:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195898624:0@lo:103: 00000100:00100000:2.0:1787384348.264374:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173854720 00000100:00100000:2.0:1787384348.264378:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173854720 00010000:00010000:2.0:1787384348.264402:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e366121000/0x3522fbed3b6c3325 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd8 expref: 10 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384348.264416:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195899136 00000100:00100000:2.0:1787384348.264419:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195899136 00010000:00010000:2.0:1787384348.264428:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c32ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c32a7 expref: 13 pid: 5777 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384348.264439:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1787384348.264446:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+10:2352:x1874208173854720:12345-192.168.203.51@tcp:103: 00010000:00010000:2.0:1787384348.264455:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384348.264459:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e366121000/0x3522fbed3b6c3325 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd8 expref: 10 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384348.264469:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e366121000/0x3522fbed3b6c3325 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd8 expref: 10 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384348.264481:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e366121000/0x3522fbed3b6c3325 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd8 expref: 10 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384348.264490:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384348.264525:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+9:2352:x1874208173854720:12345-192.168.203.51@tcp:103: Request processed in 78us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384348.264531:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1787384348.264543:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384348.264549:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349e13450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:3307:x1874208195899136:12345-0@lo:103: 00010000:00010000:2.0:1787384348.264556:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384348.264560:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c32ae lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c32a7 expref: 13 pid: 5777 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384348.264577:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c32ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c32a7 expref: 13 pid: 5777 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384348.264587:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c32ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c32a7 expref: 13 pid: 5777 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384348.264595:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384348.264622:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349e13450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:3307:x1874208195899136:12345-0@lo:103: Request processed in 74us (1204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384348.264628:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787384348.264676:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195899136:0@lo:103: 00000100:00100000:1.0:1787384348.264728:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384348.264747:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173854848 00000100:00100000:1.0:1787384348.264751:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173854848 00010000:00010000:1.0:1787384348.264768:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e35108b000/0x3522fbed3b6c331e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd1 expref: 9 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384348.264794:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:1.0:1787384348.264801:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+9:2352:x1874208173854848:12345-192.168.203.51@tcp:103: 00010000:00010000:1.0:1787384348.264808:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384348.264812:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e35108b000/0x3522fbed3b6c331e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd1 expref: 9 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264820:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e35108b000/0x3522fbed3b6c331e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd1 expref: 9 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264830:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108b000/0x3522fbed3b6c331e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78bd1 expref: 9 pid: 5776 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264841:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264849:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264926:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264945:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264952:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264960:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264967:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384348.264971:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264980:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.264995:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384348.265005:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384348.265024:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410ab480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+8:2352:x1874208173854848:12345-192.168.203.51@tcp:103: Request processed in 224us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384348.265031:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:1.0:1787384348.265058:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195899008:0@lo:103: 00000100:00100000:1.0:1787384348.265077:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195899392:0@lo:103: 00010000:00010000:0.0:1787384348.265468:0:8287:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.265478:0:8287:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384348.265485:0:8287:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c335d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8287 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384348.681234:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384349.705892:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384349.854053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384349.854089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384349.854129:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384349.854166:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384349.854278:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173854976 00000100:00100000:2.0:1787384349.854283:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173855360 00000100:00100000:0.0:1787384349.854286:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173855104 00000100:00100000:1.0:1787384349.854289:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173854976 00000100:00100000:2.0:1787384349.854290:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173855360 00000100:00100000:0.0:1787384349.854290:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173855104 00000100:00100000:2.0:1787384349.854351:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173855232 00000100:00100000:1.0:1787384349.854352:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 132 00000100:00100000:2.0:1787384349.854355:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173855232 00000100:00100000:1.0:1787384349.854381:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+8:2351:x1874208173854976:12345-192.168.203.51@tcp:400: 00000100:00100000:1.0:1787384349.854457:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+8:2351:x1874208173854976:12345-192.168.203.51@tcp:400: Request processed in 80us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384349.854465:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 132 00000100:00100000:0.0:1787384349.854524:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:0.0:1787384349.854533:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173855104:12345-192.168.203.51@tcp:400: 00000100:00100000:0.0:1787384349.854569:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173855104:12345-192.168.203.51@tcp:400: Request processed in 38us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384349.854575:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:0.0:1787384349.854614:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:0.0:1787384349.854622:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173855360:12345-192.168.203.51@tcp:400: 00000100:00100000:0.0:1787384349.854679:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173855360:12345-192.168.203.51@tcp:400: Request processed in 59us (590us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384349.854686:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00080000:3.0:1787384349.856762:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787384349.856781:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384349.856784:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384349.858579:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1787384349.858597:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173855232:12345-192.168.203.51@tcp:400: 00000100:00100000:2.0:1787384349.859553:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173855232:12345-192.168.203.51@tcp:400: Request processed in 956us (5380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384349.859563:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 10000000:01000000:0.0:1787384350.090791:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787384350.090799:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e349e43000 from 39 10000000:01000000:0.0:1787384350.090805:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787384350.090854:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384350.090882:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384350.090893:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384350.090916:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195899520:0@lo:101: 00000100:00100000:0.0:1787384350.091002:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384350.091059:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34561ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384350.091295:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195899520 00000100:00100000:1.0:1787384350.091303:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195899520 00000100:00100000:1.0:1787384350.091364:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787384350.091374:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+12:5780:x1874208195899520:12345-0@lo:101: 00010000:00010000:1.0:1787384350.091390:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384350.091405:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624de00/0x3522fbed3b6c336b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3364 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384350.091431:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624de00/0x3522fbed3b6c336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3364 expref: 13 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384350.091452:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624de00/0x3522fbed3b6c336b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3364 expref: 13 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384350.091462:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624de00, rc 0) 00000100:00100000:1.0:1787384350.091513:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195899520:12345-0@lo:101: Request processed in 141us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384350.091521:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787384350.091697:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195899520:0@lo:101: 00010000:00010000:2.0:1787384350.091715:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.091723:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384350.091825:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195899648:0@lo:501: 00000100:00100000:2.0:1787384350.091854:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384350.091896:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e345a2c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384350.092127:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195899648 00000100:00100000:1.0:1787384350.092131:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195899648 00000100:00100000:1.0:1787384350.092166:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787384350.092174:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195899648:12345-0@lo:501: 00000100:00100000:1.0:1787384350.092619:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195899648:12345-0@lo:501: Request processed in 445us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384350.092634:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1787384350.103483:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195899648:0@lo:501: 00000100:00100000:3.0:1787384350.103552:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195899776:0@lo:503: 00000100:00100000:3.0:1787384350.103633:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.103681:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384350.106591:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195899776 00000100:00100000:1.0:1787384350.106607:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195899776 00000100:00100000:1.0:1787384350.106686:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787384350.106698:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195899776:12345-0@lo:503: 00000100:00100000:1.0:1787384350.106972:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195899776:12345-0@lo:503: Request processed in 276us (3339us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384350.106979:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1787384350.109101:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195899776:0@lo:503: 00000100:00100000:3.0:1787384350.110625:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384350.110710:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173855488 00000100:00100000:0.0:1787384350.110718:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173855488 00000100:00100000:0.0:1787384350.110782:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00100000:0.0:1787384350.110792:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+8:5568:x1874208173855488:12345-192.168.203.51@tcp:101: 00010000:00010000:0.0:1787384350.110807:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384350.110824:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108ba00/0x3522fbed3b6c3372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78c3a expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384350.110851:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108ba00/0x3522fbed3b6c3372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c3a expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384350.110908:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108ba00/0x3522fbed3b6c3372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c3a expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384350.110918:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ba00, rc 0) 00000100:00100000:0.0:1787384350.110982:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+9:5568:x1874208173855488:12345-192.168.203.51@tcp:101: Request processed in 191us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.110989:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00100000:1.0:1787384350.113413:0:8308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8308:1874208195899904:0@lo:502: 00000100:00100000:1.0:1787384350.113507:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384350.113553:0:8308:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d80c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384350.115585:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195899904 00000100:00100000:0.0:1787384350.115598:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195899904 00000100:00100000:0.0:1787384350.115669:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787384350.115679:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:8308:x1874208195899904:12345-0@lo:502: 00000100:00100000:0.0:1787384350.116026:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:8308:x1874208195899904:12345-0@lo:502: Request processed in 347us (2517us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.116033:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1787384350.116817:0:8308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8308:1874208195899904:0@lo:502: 00000100:00100000:3.0:1787384350.116915:0:8308:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8308:1874208195900032:0@lo:502: 00000100:00100000:3.0:1787384350.116970:0:8308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.116999:0:8308:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787384350.118566:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195900032 00000100:00100000:1.0:1787384350.118579:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195900032 00000100:00100000:1.0:1787384350.118652:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787384350.118663:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:8308:x1874208195900032:12345-0@lo:502: 00000100:00100000:1.0:1787384350.118985:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:8308:x1874208195900032:12345-0@lo:502: Request processed in 324us (2014us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384350.118993:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1787384350.119264:0:8308:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8308:1874208195900032:0@lo:502: 00000040:00080000:3.0:1787384350.119297:0:8308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1787384350.119606:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1787384350.119627:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787384350.119638:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384350.119648:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384350.119657:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1787384350.119660:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1787384350.119663:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787384350.119692:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384350.119714:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384350.119723:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384350.119742:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195900160:0@lo:101: 00000100:00100000:0.0:1787384350.119794:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384350.119828:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34561e300 going to sleep for 11 seconds 00000100:00100000:1.0:1787384350.120651:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195900160 00000100:00100000:1.0:1787384350.120660:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195900160 00000100:00100000:1.0:1787384350.120712:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787384350.120721:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+13:5780:x1874208195900160:12345-0@lo:101: 00010000:00010000:1.0:1787384350.120735:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384350.120747:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624c400/0x3522fbed3b6c3380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3379 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384350.122147:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624c400/0x3522fbed3b6c3380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3379 expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384350.122183:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624c400/0x3522fbed3b6c3380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3379 expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384350.122193:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c400, rc 0) 00000100:00100000:1.0:1787384350.122284:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195900160:12345-0@lo:101: Request processed in 1555us (2480us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384350.122292:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787384350.122460:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195900160:0@lo:101: 00010000:00010000:3.0:1787384350.122478:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.122487:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384350.122560:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195900288:0@lo:501: 00000100:00100000:3.0:1787384350.122591:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.122619:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384350.123385:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195900288 00000100:00100000:0.0:1787384350.123392:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195900288 00000100:00100000:0.0:1787384350.123437:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787384350.123456:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195900288:12345-0@lo:501: 00000100:00100000:0.0:1787384350.123724:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195900288:12345-0@lo:501: Request processed in 269us (1132us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.123732:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1787384350.126736:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195900288:0@lo:501: 00000100:00100000:3.0:1787384350.126804:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195900416:0@lo:503: 00000100:00100000:3.0:1787384350.126896:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.126925:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384350.126944:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195900416 00000100:00100000:3.0:1787384350.126950:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195900416 00000100:00100000:3.0:1787384350.126996:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787384350.127006:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195900416:12345-0@lo:503: 00000100:00100000:3.0:1787384350.127185:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195900416:12345-0@lo:503: Request processed in 180us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384350.127193:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787384350.127244:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195900416:0@lo:503: 00000100:00100000:1.0:1787384350.127682:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384350.127702:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173855616 00000100:00100000:1.0:1787384350.127706:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173855616 00000100:00100000:1.0:1787384350.127732:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 142 00000100:00100000:1.0:1787384350.127739:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+9:5568:x1874208173855616:12345-192.168.203.51@tcp:501: 00000100:00100000:1.0:1787384350.127996:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+9:5568:x1874208173855616:12345-192.168.203.51@tcp:501: Request processed in 257us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384350.128003:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 142 00000100:00100000:1.0:1787384350.131364:0:8309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8309:1874208195900544:0@lo:502: 00000100:00100000:1.0:1787384350.134670:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384350.134727:0:8309:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461cc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384350.135165:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384350.135307:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195900544 00000100:00100000:2.0:1787384350.135317:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195900544 00000100:00100000:2.0:1787384350.135368:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173855744 00000100:00100000:2.0:1787384350.135372:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173855744 00000100:00100000:2.0:1787384350.135389:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787384350.135396:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:8309:x1874208195900544:12345-0@lo:502: 00000100:00100000:2.0:1787384350.135638:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:8309:x1874208195900544:12345-0@lo:502: Request processed in 241us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.135646:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787384350.135681:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:2.0:1787384350.135688:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+9:5568:x1874208173855744:12345-192.168.203.51@tcp:503: 00000100:00100000:2.0:1787384350.135829:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+9:5568:x1874208173855744:12345-192.168.203.51@tcp:503: Request processed in 140us (666us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.135836:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:1.0:1787384350.137832:0:8309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8309:1874208195900544:0@lo:502: 00000020:01000000:1.0:1787384350.137895:0:8309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384350.137905:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384350.137908:0:8309:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787384350.137913:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787384350.137947:0:8309:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8309:1874208195900672:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384350.138019:0:8309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384350.138066:0:8309:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461cc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384350.138984:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195900672 00000100:00100000:2.0:1787384350.138993:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195900672 00000100:00100000:2.0:1787384350.139046:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787384350.139056:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:8309:x1874208195900672:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384350.139292:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:8309:x1874208195900672:12345-0@lo:502:llog_process_th.0 Request processed in 236us (1271us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.139300:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1787384350.140170:0:8309:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8309:1874208195900672:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384350.140203:0:8309:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384350.140211:0:8309:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384350.140214:0:8309:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787384350.140218:0:8309:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:3.0:1787384350.149191:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:3.0:1787384350.149230:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787384350.149453:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.149467:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384350.149822:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384350.149926:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173855872 00000100:00100000:0.0:1787384350.149934:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173855872 00000100:00100000:0.0:1787384350.150005:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 146 00000100:00100000:0.0:1787384350.150015:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+9:6040:x1874208173855872:12345-192.168.203.51@tcp:502: 00000100:00100000:0.0:1787384350.150312:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+9:6040:x1874208173855872:12345-192.168.203.51@tcp:502: Request processed in 297us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.150322:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 146 10000000:01000000:2.0:1787384350.150326:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787384350.150336:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e3450ec800 from 39 10000000:01000000:2.0:1787384350.150340:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787384350.150374:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.150385:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.150394:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384350.150415:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195900800:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.150455:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384350.150495:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e345a2c900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384350.150553:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195900800 00000100:00100000:3.0:1787384350.150558:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195900800 00000100:00100000:3.0:1787384350.150639:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1787384350.150647:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:5780:x1874208195900800:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384350.150655:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384350.150667:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c338e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3387 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.150690:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c338e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3387 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.150700:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c338e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3387 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.150709:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3429d4e00, rc 0) 00000100:00100000:3.0:1787384350.150754:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195900800:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384350.150760:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787384350.150834:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195900800:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384350.150847:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384350.150882:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384350.150940:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195900928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.150965:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384350.155788:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3729e1b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384350.159522:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195900928 00000100:00100000:2.0:1787384350.159537:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195900928 00000100:00100000:2.0:1787384350.159592:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1787384350.159602:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195900928:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.159912:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195900928:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 310us (8944us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.159919:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787384350.160059:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195900928:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.160105:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195901056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.160151:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384350.160184:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3729e1b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384350.160380:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195901056 00000100:00100000:3.0:1787384350.160386:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195901056 00000100:00100000:0.0:1787384350.165420:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384350.165570:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173856000 00000100:00100000:0.0:1787384350.165579:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173856000 00000100:00100000:0.0:1787384350.165601:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787384350.165610:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195901056:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.165831:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195901056:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 222us (5678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.165838:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1787384350.165908:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 150 00000100:00100000:0.0:1787384350.165915:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+9:6040:x1874208173856000:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384350.166061:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+9:6040:x1874208173856000:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 145us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.166068:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 150 00000100:00100000:3.0:1787384350.166462:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195901056:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384350.167970:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8310:1874208195901184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384350.168037:0:8310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.168081:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384350.168139:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195901184 00000100:00100000:2.0:1787384350.168145:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195901184 00000100:00100000:2.0:1787384350.168187:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787384350.168196:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:8310:x1874208195901184:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384350.168426:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:8310:x1874208195901184:12345-0@lo:502:llog_process_th.0 Request processed in 230us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.168433:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787384350.168675:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8310:1874208195901184:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384350.168719:0:8310:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8310:1874208195901312:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384350.168752:0:8310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.168780:0:8310:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384350.168824:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195901312 00000100:00100000:2.0:1787384350.168829:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195901312 00000100:00100000:2.0:1787384350.168856:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787384350.168888:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:8310:x1874208195901312:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384350.169023:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:8310:x1874208195901312:12345-0@lo:502:llog_process_th.0 Request processed in 135us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.169029:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787384350.169109:0:8310:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8310:1874208195901312:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787384350.169127:0:8310:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787384350.169385:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787384350.169402:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787384350.169412:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.169424:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384350.169433:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787384350.169435:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787384350.169438:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787384350.169462:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.169470:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.169480:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384350.169494:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195901440:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.169522:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384350.169558:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e345a2c9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384350.169637:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195901440 00000100:00100000:3.0:1787384350.169647:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195901440 00000100:00100000:3.0:1787384350.169668:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1787384350.169674:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:5780:x1874208195901440:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384350.169683:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384350.169694:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e3429d4600/0x3522fbed3b6c339c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3395 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.169714:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3429d4600/0x3522fbed3b6c339c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3395 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.169725:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e3429d4600/0x3522fbed3b6c339c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3395 expref: 16 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.169734:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3429d4600, rc 0) 00000100:00100000:3.0:1787384350.169761:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195901440:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384350.169780:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787384350.170422:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195901440:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384350.170434:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.170444:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384350.170491:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195901568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.170520:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384350.170549:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e345a2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384350.170620:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195901568 00000100:00100000:0.0:1787384350.170624:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195901568 00000100:00100000:0.0:1787384350.170647:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787384350.170653:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195901568:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.170903:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195901568:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 248us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.170910:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1787384350.171276:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195901568:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.171306:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195901696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.171346:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384350.171375:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e345a2c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384350.171477:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195901696 00000100:00100000:0.0:1787384350.171481:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195901696 00000100:00100000:0.0:1787384350.171502:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787384350.171508:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195901696:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.171649:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195901696:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 141us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.171656:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1787384350.173838:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195901696:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.174444:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8311:1874208195901824:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384350.174516:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384350.174555:0:8311:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e345a2c540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384350.174965:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195901824 00000100:00100000:0.0:1787384350.174972:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195901824 00000100:00100000:0.0:1787384350.175013:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1787384350.175022:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:8311:x1874208195901824:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384350.175352:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:8311:x1874208195901824:12345-0@lo:502:llog_process_th.0 Request processed in 330us (834us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.175359:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1787384350.181523:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8311:1874208195901824:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384350.182409:0:8311:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384350.182423:0:8311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384350.182426:0:8311:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787384350.182434:0:8311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1787384350.182490:0:8311:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8311:1874208195901952:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384350.182579:0:8311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384350.182620:0:8311:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4000 going to sleep for 11 seconds 00000100:00100000:3.0:1787384350.183403:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195901952 00000100:00100000:3.0:1787384350.183413:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195901952 00000100:00100000:3.0:1787384350.183464:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787384350.183474:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:8311:x1874208195901952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384350.183730:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:8311:x1874208195901952:12345-0@lo:502:llog_process_th.0 Request processed in 257us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384350.183738:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1787384350.183893:0:8311:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8311:1874208195901952:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384350.183919:0:8311:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384350.183925:0:8311:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384350.183927:0:8311:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1787384350.183932:0:8311:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1787384350.184426:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1787384350.184443:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1787384350.184452:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.184472:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384350.184482:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787384350.184485:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e348611800 from 39 10000000:01000000:3.0:1787384350.184488:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787384350.184525:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.184533:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.184541:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384350.184559:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384350.184592:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.184624:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384350.184675:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195902080 00000100:00100000:2.0:1787384350.184680:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195902080 00000100:00100000:2.0:1787384350.184723:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787384350.184730:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195902080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384350.184740:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384350.184754:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e366121a00/0x3522fbed3b6c33aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c33a3 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.184786:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e366121a00/0x3522fbed3b6c33aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c33a3 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.184796:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e366121a00/0x3522fbed3b6c33aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c33a3 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.184805:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121a00, rc 0) 00000100:00100000:2.0:1787384350.184835:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195902080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.184841:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787384350.185935:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384350.185963:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.185973:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384350.186031:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384350.186064:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.186098:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b0300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384350.186658:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195902208 00000100:00100000:2.0:1787384350.186666:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195902208 00000100:00100000:2.0:1787384350.186701:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787384350.186710:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195902208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.187191:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195902208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 481us (1125us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.187199:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1787384350.187613:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.187656:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.187702:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384350.187736:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787384350.187791:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195902336 00000100:00100000:3.0:1787384350.187795:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195902336 00000100:00100000:3.0:1787384350.187833:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787384350.187842:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195902336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.188348:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195902336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 507us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.188357:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1787384350.188441:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.190551:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384350.191851:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173856128 00000100:00100000:3.0:1787384350.191906:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173856128 00000100:00100000:3.0:1787384350.191969:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 161 00000100:00100000:3.0:1787384350.191978:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+9:5568:x1874208173856128:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384350.191996:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384350.192014:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340031200/0x3522fbed3b6c33b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78c41 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.192043:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340031200/0x3522fbed3b6c33b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c41 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.192055:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340031200/0x3522fbed3b6c33b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c41 expref: 10 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.192064:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031200, rc 0) 00000100:00100000:3.0:1787384350.192115:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:5568:x1874208173856128:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 138us (1572us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384350.192122:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 161 00000100:00100000:3.0:1787384350.198525:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8312:1874208195902464:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384350.198617:0:8312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.198661:0:8312:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b06c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384350.199556:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195902464 00000100:00100000:0.0:1787384350.199566:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195902464 00000100:00100000:0.0:1787384350.199622:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787384350.199632:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:8312:x1874208195902464:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384350.200457:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:8312:x1874208195902464:12345-0@lo:502:llog_process_th.0 Request processed in 824us (1836us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.200466:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1787384350.202290:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384350.202420:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173856256 00000100:00100000:2.0:1787384350.202428:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173856256 00000100:00100000:2.0:1787384350.202481:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 163 00000100:00100000:2.0:1787384350.202491:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:5568:x1874208173856256:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.202771:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:5568:x1874208173856256:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 274us (482us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787384350.202786:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 163 00000100:00100000:1.0:1787384350.206154:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8312:1874208195902464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384350.206491:0:8312:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8312:1874208195902592:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384350.206565:0:8312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384350.206645:0:8312:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461ccc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384350.206688:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195902592 00000100:00100000:0.0:1787384350.206695:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195902592 00000100:00100000:0.0:1787384350.206836:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1787384350.206848:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:8312:x1874208195902592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384350.207408:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:8312:x1874208195902592:12345-0@lo:502:llog_process_th.0 Request processed in 560us (841us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.207416:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787384350.207725:0:8312:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8312:1874208195902592:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787384350.207973:0:8312:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1787384350.208205:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1787384350.208223:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384350.208252:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.208263:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384350.208273:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1787384350.208275:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1787384350.208278:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787384350.208307:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.208314:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.208323:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384350.208341:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384350.208555:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.208594:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3729e1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384350.208689:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195902720 00000100:00100000:1.0:1787384350.208695:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195902720 00000100:00100000:1.0:1787384350.208738:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1787384350.208746:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195902720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384350.208757:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384350.209070:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c33bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c33b8 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384350.209093:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c33bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c33b8 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384350.209103:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c33bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c33b8 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384350.209111:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c800, rc 0) 00000100:00100000:1.0:1787384350.209205:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195902720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 458us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384350.209211:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787384350.209478:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384350.209491:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.209500:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384350.209561:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384350.209590:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.209619:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3729e1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787384350.209666:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195902848 00000100:00100000:2.0:1787384350.209671:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195902848 00000100:00100000:2.0:1787384350.209734:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1787384350.209759:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195902848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.210926:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195902848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1171us (1329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.210936:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1787384350.211058:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384350.211098:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384350.211144:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.212506:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3729e1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384350.212688:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195902976 00000100:00100000:1.0:1787384350.212695:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195902976 00000100:00100000:1.0:1787384350.212995:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1787384350.213006:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195902976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384350.213253:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195902976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (2108us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384350.213261:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787384350.213624:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195902976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384350.215075:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8313:1874208195903104:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384350.215147:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384350.215224:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3430c9f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384350.215466:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195903104 00000100:00100000:0.0:1787384350.215472:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195903104 00000100:00100000:1.0:1787384350.215575:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787384350.215589:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:8313:x1874208195903104:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384350.216535:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:8313:x1874208195903104:12345-0@lo:502:llog_process_th.0 Request processed in 946us (1383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.216545:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1787384350.216620:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bc000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8313:1874208195903104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384350.216652:0:8313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384350.216660:0:8313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384350.216662:0:8313:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787384350.216668:0:8313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787384350.216696:0:8313:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8313:1874208195903232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384350.216735:0:8313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384350.216898:0:8313:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461cc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384350.217141:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195903232 00000100:00100000:0.0:1787384350.217147:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195903232 00000100:00100000:0.0:1787384350.217185:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1787384350.217194:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:8313:x1874208195903232:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384350.217633:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:8313:x1874208195903232:12345-0@lo:502:llog_process_th.0 Request processed in 439us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384350.217640:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1787384350.217708:0:8313:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8313:1874208195903232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384350.217731:0:8313:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384350.217736:0:8313:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384350.217738:0:8313:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787384350.217742:0:8313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787384350.218155:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1787384350.218173:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787384350.218184:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.218196:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384350.218206:0:5780:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1787384350.218209:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89e351ef8000 from 1 10000000:01000000:3.0:1787384350.218212:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787384350.218423:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030a00/0x3522fbed3b6c33c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.218433:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340030a00/0x3522fbed3b6c33c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.218444:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340030a00/0x3522fbed3b6c33c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384350.218474:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195903360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384350.218512:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.218587:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3729e1000 going to sleep for 11 seconds 00000100:00100000:2.0:1787384350.218710:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195903360 00000100:00100000:2.0:1787384350.218716:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195903360 00000100:00100000:2.0:1787384350.219145:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787384350.219155:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195903360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384350.219166:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384350.219179:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e366120000/0x3522fbed3b6c33cd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c33c6 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.219201:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e366120000/0x3522fbed3b6c33cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c33c6 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.219211:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e366120000/0x3522fbed3b6c33cd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c33c6 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384350.219227:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120000, rc 0) 00000100:00100000:2.0:1787384350.219300:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195903360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384350.219306:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787384350.219382:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195903360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384350.219395:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340030a00/0x3522fbed3b6c33c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33cd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.219405:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340030a00/0x3522fbed3b6c33c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c33cd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384350.219455:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195903488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384350.219480:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384350.221724:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3729e1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384350.222086:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195903488 00000100:00100000:1.0:1787384350.222112:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195903488 00000100:00100000:0.0:1787384350.222518:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787384350.222530:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195903488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384350.223150:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195903488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 621us (3667us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384350.223158:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787384350.223591:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195903488:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1787384350.223627:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787384350.223636:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030a00/0x3522fbed3b6c33c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33cd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.223647:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340030a00/0x3522fbed3b6c33c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33cd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384350.729600:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384351.755881:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787384351.822056:0:8351:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc6aefe4b0 00000020:00000080:1.0:1787384351.822072:0:8351:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787384351.822077:0:8351:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787384351.822085:0:8351:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6af00740 20000000:00000080:1.0:1787384351.822092:0:8351:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e37b6b9800 uarg=0000000000000000 20000000:01000000:1.0:1787384351.822130:0:8351:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787384351.822135:0:8351:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787384351.822140:0:8351:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787384351.825719:0:8352:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1787384351.826377:0:8351:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:1.0:1787384351.832071:0:8351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:1.0:1787384351.832127:0:8351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:1.0:1787384351.832180:0:8351:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:1.0:1787384351.832204:0:8351:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787384351.832234:0:8351:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832254:0:8351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e3429d5c00/0x3522fbed3b6c319d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3196 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832263:0:8351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c321b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3214 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832270:0:8351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e35108b400/0x3522fbed3b6c3276 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c326f expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832280:0:8351:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e3429d4c00/0x3522fbed3b6c3333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c09 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832289:0:8351:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832395:0:8351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e3429d4c00/0x3522fbed3b6c3333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c09 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832422:0:8351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e3429d4c00/0x3522fbed3b6c3333 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c09 expref: 9 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384351.832437:0:8351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8351:1874208195903616:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384351.832542:0:8351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e35108b400/0x3522fbed3b6c3276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c326f expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832551:0:8351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e35108b400/0x3522fbed3b6c3276 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c326f expref: 18 pid: 5776 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384351.832560:0:8351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8351:1874208195903744:0@lo:104: 00000100:00100000:1.0:1787384351.832600:0:8351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.832646:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195903744 00000100:00100000:1.0:1787384351.832653:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195903744 00000100:00100000:1.0:1787384351.832696:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384351.832705:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:8351:x1874208195903744:12345-0@lo:104: 00010000:00010000:1.0:1787384351.832717:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832760:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384351.832766:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:8351:x1874208195903744:12345-0@lo:104: Request processed in 63us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.832773:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1787384351.832808:0:8351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c321b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c3214 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832816:0:8351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c321b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c3214 expref: 18 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384351.832832:0:8351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8351:1874208195903872:0@lo:104: 00000100:00100000:1.0:1787384351.832885:0:8351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.832909:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787384351.832918:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195903872 00000100:00100000:1.0:1787384351.832921:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195903872 00000100:00100000:1.0:1787384351.832938:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384351.832944:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:8351:x1874208195903872:12345-0@lo:104: 00010000:00010000:1.0:1787384351.832950:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.832981:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787384351.832986:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b6b9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:8351:x1874208195903872:12345-0@lo:104: Request processed in 42us (128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.832991:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:1.0:1787384351.833039:0:8351:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e3429d5c00/0x3522fbed3b6c319d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c3196 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.833047:0:8351:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e3429d5c00/0x3522fbed3b6c319d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c3196 expref: 18 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384351.833056:0:8351:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8351:1874208195904000:0@lo:104: 00000100:00100000:1.0:1787384351.833076:0:8351:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384351.833094:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195904000 00000100:00100000:1.0:1787384351.833098:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195904000 00000100:00100000:1.0:1787384351.833114:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384351.833119:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:8351:x1874208195904000:12345-0@lo:104: 00010000:00010000:1.0:1787384351.833126:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e341677800/0x3522fbed3b6c3196 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.833162:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787384351.833167:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:8351:x1874208195904000:12345-0@lo:104: Request processed in 48us (90us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384351.833173:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384351.833192:0:8351:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461cc0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384351.833213:0:8351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8351:1874208195903744:0@lo:104: 00000100:00100000:1.0:1787384351.833222:0:8351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8351:1874208195903872:0@lo:104: 00000100:00100000:1.0:1787384351.833245:0:8351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8351:1874208195904000:0@lo:104: 00010000:00010000:3.0:1787384351.833644:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787384351.833651:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833666:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384351.833671:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833680:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384351.833687:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384351.833693:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787384351.833730:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833737:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384351.833758:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833765:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c326f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3276 expref: -99 pid: 7466 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833777:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384351.833780:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833786:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd000 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384351.833789:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833807:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384351.833814:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384351.833820:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787384351.833833:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833839:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384351.833846:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833852:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3413fd000/0x3522fbed3b6c3214 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c321b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833880:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384351.833884:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e341677800/0x3522fbed3b6c3196 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833890:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677800 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384351.833893:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e341677800/0x3522fbed3b6c3196 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833901:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e341677800/0x3522fbed3b6c3196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384351.833908:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e341677800/0x3522fbed3b6c3196 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384351.833919:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787384351.833932:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e341677800/0x3522fbed3b6c3196 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833950:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384351.833964:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e341677800/0x3522fbed3b6c3196 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833972:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e341677800/0x3522fbed3b6c3196 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c319d expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.833986:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384351.833988:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384351.833990:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384351.833996:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384351.834001:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384351.834012:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195904128:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384351.834044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.834067:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384351.834072:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195904256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384351.834091:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.834114:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195904384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384351.834133:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384351.834161:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195904128 00000100:00100000:3.0:1787384351.834165:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195904128 00010000:00010000:3.0:1787384351.834185:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e35108b400/0x3522fbed3b6c3276 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c326f expref: 19 pid: 5776 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.834217:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195904256 00000100:00100000:3.0:1787384351.834220:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195904256 00010000:00010000:3.0:1787384351.834244:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c321b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3214 expref: 20 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.834256:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195904384 00000100:00100000:3.0:1787384351.834258:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195904384 00010000:00010000:3.0:1787384351.834267:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e3429d5c00/0x3522fbed3b6c319d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3196 expref: 21 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.834278:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787384351.834285:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+21:3306:x1874208195904128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384351.834304:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384351.834311:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e35108b400/0x3522fbed3b6c3276 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c326f expref: 21 pid: 5776 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.834321:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e35108b400/0x3522fbed3b6c3276 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c326f expref: 21 pid: 5776 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.834334:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108b400/0x3522fbed3b6c3276 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c326f expref: 21 pid: 5776 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.834345:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384351.834372:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+20:3306:x1874208195904128:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.834378:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787384351.834391:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787384351.834396:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195904256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384351.834413:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384351.834417:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c321b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3214 expref: 19 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.834425:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c321b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c3214 expref: 19 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.834436:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c321b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c3214 expref: 19 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.834444:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384351.834467:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3306:x1874208195904256:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.834473:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787384351.834486:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787384351.834491:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:3304:x1874208195904384:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384351.834498:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384351.834502:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e3429d5c00/0x3522fbed3b6c319d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3196 expref: 17 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.834511:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e3429d5c00/0x3522fbed3b6c319d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c3196 expref: 17 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.834521:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3429d5c00/0x3522fbed3b6c319d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c3196 expref: 17 pid: 5777 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.834530:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384351.834554:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3304:x1874208195904384:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (420us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.834568:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787384351.834607:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195904384:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384351.834628:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195904256:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384351.834635:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195904128:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384351.840031:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384351.840333:0:8351:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8351:1874208195903616:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384351.840374:0:8351:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.840542:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173856384 00000100:00100000:3.0:1787384351.840550:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173856384 00010000:00010000:3.0:1787384351.840583:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e3429d4c00/0x3522fbed3b6c3333 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c09 expref: 10 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384351.840610:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:3.0:1787384351.840619:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+10:2352:x1874208173856384:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384351.840634:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384351.840640:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e3429d4c00/0x3522fbed3b6c3333 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c09 expref: 10 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840652:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e3429d4c00/0x3522fbed3b6c3333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c09 expref: 10 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840669:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3429d4c00/0x3522fbed3b6c3333 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c09 expref: 10 pid: 5777 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840685:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840694:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840727:0:5769:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840735:0:5769:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840741:0:5769:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840749:0:5769:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840765:0:5769:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624ce00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384351.840770:0:5769:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840778:0:5769:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840796:0:5769:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384351.840806:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384351.840879:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+9:2352:x1874208173856384:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 242us (838us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384351.840887:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00010000:00010000:1.0:1787384351.841126:0:8351:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.841136:0:8351:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384351.841143:0:8351:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624ce00/0x3522fbed3b6c33d4 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8351 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384352.329148:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195904512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384352.329216:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384352.329413:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195904512 00000100:00100000:3.0:1787384352.329422:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195904512 00000100:00080000:1.0:1787384352.329663:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384352.329879:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384352.329891:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195904512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384352.329940:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384352.329995:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195904512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384352.330002:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787384352.330067:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37275f480 x1874208195904512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384368 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384352.330086:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195904512:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787384352.784379:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384352.841958:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195904768:0@lo:400:kworker.0 00000100:00100000:1.0:1787384352.841959:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195904896:0@lo:400:kworker.0 00000100:00100000:2.0:1787384352.842051:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195904640:0@lo:400:kworker.0 00000100:00100000:1.0:1787384352.843911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384352.843944:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384352.844029:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195904896 00000100:00100000:0.0:1787384352.844038:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195904896 00000100:00100000:0.0:1787384352.844090:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195904768 00000100:00100000:0.0:1787384352.844094:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195904768 00000100:00100000:0.0:1787384352.844121:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787384352.844130:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195904896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384352.844258:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195904896:12345-0@lo:400:kworker.0 Request processed in 128us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384352.844265:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787384352.844351:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787384352.844368:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195904768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384352.844408:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195904768:12345-0@lo:400:kworker.0 Request processed in 43us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384352.844415:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787384352.846936:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195904768:0@lo:400:kworker.0 00000100:00100000:2.0:1787384352.849657:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384352.849697:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195904896:0@lo:400:kworker.0 00000100:00100000:2.0:1787384352.849710:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195905152:0@lo:400:kworker.0 00000100:00100000:1.0:1787384352.849724:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787384352.849735:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195905024:0@lo:400:kworker.0 00000100:00100000:1.0:1787384352.849785:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384352.849821:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384352.849830:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195905024 00000100:00100000:1.0:1787384352.849837:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195905024 00000100:00100000:2.0:1787384352.849883:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195905152 00000100:00100000:2.0:1787384352.849888:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195905152 00000100:00100000:1.0:1787384352.849914:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384352.849925:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195905024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384352.849931:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384352.849941:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195905152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384352.849987:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195905024:12345-0@lo:400:kworker.0 Request processed in 64us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384352.849995:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384352.850000:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195905152:12345-0@lo:400:kworker.0 Request processed in 59us (177us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384352.850008:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1787384352.850019:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384352.850026:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787384352.850052:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c5afb80 x1874208195905152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384368 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384352.850062:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195905024:0@lo:400:kworker.0 00000100:00100000:2.0:1787384352.850067:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195905152:0@lo:400:kworker.0 00000100:00100000:0.0:1787384352.850404:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195904640 00000100:00100000:0.0:1787384352.850409:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195904640 00000100:00100000:0.0:1787384352.850447:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787384352.850455:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3306:x1874208195904640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384352.850500:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3306:x1874208195904640:12345-0@lo:400:kworker.0 Request processed in 45us (849us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384352.850507:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787384352.850509:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195904640:0@lo:400:kworker.0 00000100:00100000:2.0:1787384353.056607:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384353.057897:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173856512 00000100:00100000:1.0:1787384353.057908:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173856512 00000100:00100000:1.0:1787384353.058034:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 173 00000100:00100000:1.0:1787384353.058047:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+9:5568:x1874208173856512:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384353.058063:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384353.058081:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c33db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78c48 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384353.058231:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c33db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c48 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384353.058261:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c33db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c48 expref: 10 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384353.058270:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d400, rc 0) 00000100:00100000:1.0:1787384353.058327:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:5568:x1874208173856512:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 284us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384353.058334:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 173 00000100:00100000:2.0:1787384353.065114:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384353.065378:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173856640 00000100:00100000:3.0:1787384353.065388:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173856640 00000100:00100000:3.0:1787384353.065854:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 174 00000100:00100000:3.0:1787384353.065892:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:5568:x1874208173856640:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.067156:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:5568:x1874208173856640:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 1260us (2051us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.067167:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 174 00000100:00100000:2.0:1787384353.075668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384353.075791:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173856768 00000100:00100000:0.0:1787384353.075802:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173856768 00000100:00100000:0.0:1787384353.075876:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 175 00000100:00100000:0.0:1787384353.075887:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:5568:x1874208173856768:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384353.076114:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:5568:x1874208173856768:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 228us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384353.076122:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 175 00000100:00100000:2.0:1787384353.088011:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384353.089113:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173856896 00000100:00100000:3.0:1787384353.089124:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173856896 00000100:00100000:3.0:1787384353.089184:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 176 00000100:00100000:3.0:1787384353.089271:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:6097:x1874208173856896:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384353.089504:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:6097:x1874208173856896:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 310us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.089512:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 176 00000100:00100000:0.0:1787384353.105544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384353.107322:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173857024 00000100:00100000:3.0:1787384353.107336:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173857024 00000100:00100000:3.0:1787384353.107391:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 177 00000100:00100000:3.0:1787384353.107401:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:6097:x1874208173857024:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384353.107650:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:6097:x1874208173857024:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 250us (2115us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.107664:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 177 00000100:00100000:2.0:1787384353.353005:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384353.353028:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195905280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384353.353102:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384353.353182:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195905280 00000100:00100000:2.0:1787384353.353190:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195905280 00000100:00100000:2.0:1787384353.353244:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787384353.353253:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195905280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384353.353286:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384353.353329:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195905280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384353.353336:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1787384353.353380:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2bd180 x1874208195905280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384369 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384353.353398:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195905280:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1787384353.738141:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787384353.738148:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e349e43000 from 4 10000000:01000000:1.0:1787384353.738153:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787384353.738193:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384353.738217:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384353.738228:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384353.738254:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195905408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787384353.738319:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384353.738359:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195905408 00000100:00100000:1.0:1787384353.738361:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aefa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384353.738367:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195905408 00000100:00100000:0.0:1787384353.738420:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787384353.738430:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195905408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384353.738443:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384353.738461:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c33e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c33e2 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384353.738484:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c33e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c33e2 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384353.738494:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c33e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c33e2 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384353.738502:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a000, rc 0) 00000100:00100000:0.0:1787384353.738546:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195905408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384353.738552:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:1.0:1787384353.738598:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195905408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384353.738615:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384353.738622:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384353.738690:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195905536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384353.738714:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384353.738733:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aefa80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384353.740350:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195905536 00000100:00100000:0.0:1787384353.740362:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195905536 00000100:00100000:0.0:1787384353.740646:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1787384353.740656:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195905536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384353.742061:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195905536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1400us (3339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384353.742071:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1787384353.742192:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5aca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195905536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.742356:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195905664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.742523:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384353.742556:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787384353.742654:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195905664 00000100:00100000:0.0:1787384353.742660:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195905664 00000100:00100000:0.0:1787384353.742698:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787384353.742706:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195905664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384353.743296:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195905664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384353.743975:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195905664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1267us (1449us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384353.743990:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787384353.747906:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8423:1874208195905792:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384353.747987:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384353.748025:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7840 going to sleep for 11 seconds 00000100:00100000:3.0:1787384353.748901:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195905792 00000100:00100000:3.0:1787384353.748910:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195905792 00000100:00100000:3.0:1787384353.748966:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1787384353.748976:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:8423:x1874208195905792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384353.749479:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:8423:x1874208195905792:12345-0@lo:502:llog_process_th.0 Request processed in 502us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.749488:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787384353.749921:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8423:1874208195905792:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384353.749957:0:8423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384353.749967:0:8423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384353.749969:0:8423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787384353.749979:0:8423:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e349e43000 00000020:00000080:0.0:1787384353.749981:0:8423:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787384353.750071:0:8423:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8423:1874208195905920:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384353.750114:0:8423:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384353.750140:0:8423:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7840 going to sleep for 11 seconds 00000100:00100000:3.0:1787384353.750666:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195905920 00000100:00100000:3.0:1787384353.750673:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195905920 00000100:00100000:3.0:1787384353.750712:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787384353.750721:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:8423:x1874208195905920:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384353.751117:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:8423:x1874208195905920:12345-0@lo:502:llog_process_th.0 Request processed in 397us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.751127:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787384353.751692:0:8423:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8423:1874208195905920:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384353.751720:0:8423:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384353.751728:0:8423:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384353.751730:0:8423:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787384353.751736:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787384353.752525:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787384353.752552:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384353.752563:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.752576:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384353.752593:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384353.752596:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e3450ec800 from 4 10000000:01000000:3.0:1787384353.752599:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384353.752631:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.752639:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.752647:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384353.752665:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.752708:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384353.752738:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384353.752922:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195906048 00000100:00100000:3.0:1787384353.752930:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195906048 00000100:00100000:3.0:1787384353.752967:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787384353.752975:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195906048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384353.752986:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384353.752997:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340031400/0x3522fbed3b6c33f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c33f0 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.753019:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340031400/0x3522fbed3b6c33f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c33f0 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.753031:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340031400/0x3522fbed3b6c33f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c33f0 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.753050:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031400, rc 0) 00000100:00100000:3.0:1787384353.753086:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195906048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.753092:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787384353.753130:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384353.753142:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.753150:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384353.753229:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.753253:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384353.753266:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384353.753278:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195906176 00000100:00100000:3.0:1787384353.753282:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195906176 00000100:00100000:3.0:1787384353.753301:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787384353.753307:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195906176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.753783:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195906176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 474us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.753807:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1787384353.753853:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.753923:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.753989:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384353.754023:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384353.754037:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195906304 00000100:00100000:3.0:1787384353.754042:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195906304 00000100:00100000:3.0:1787384353.754097:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787384353.754119:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195906304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.754283:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195906304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.754291:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1787384353.754326:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.755349:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8426:1874208195906432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384353.755660:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384353.755717:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195906432 00000100:00100000:3.0:1787384353.755737:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195906432 00000100:00100000:3.0:1787384353.756001:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787384353.756047:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:8426:x1874208195906432:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384353.756542:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:8426:x1874208195906432:12345-0@lo:502:llog_process_th.0 Request processed in 508us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.756550:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1787384353.756596:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384353.756613:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8426:1874208195906432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384353.756641:0:8426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384353.756650:0:8426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384353.756652:0:8426:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787384353.756658:0:8426:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e3450ec800 00000020:00000080:3.0:1787384353.756661:0:8426:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787384353.756739:0:8426:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8426:1874208195906560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384353.757434:0:8426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384353.757463:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195906560 00000100:00100000:3.0:1787384353.757467:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195906560 00000100:00100000:3.0:1787384353.757494:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787384353.757500:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:8426:x1874208195906560:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384353.757619:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:8426:x1874208195906560:12345-0@lo:502:llog_process_th.0 Request processed in 118us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.757625:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1787384353.757654:0:8426:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384353.757665:0:8426:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8426:1874208195906560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384353.757682:0:8426:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384353.757687:0:8426:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384353.757689:0:8426:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787384353.757693:0:8426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787384353.757746:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787384353.757760:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384353.758855:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.759042:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384353.759067:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384353.759070:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e348611800 from 4 10000000:01000000:3.0:1787384353.759073:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384353.759133:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.759141:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.759856:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384353.760612:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.760696:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384353.760753:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b06c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384353.760791:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195906688 00000100:00100000:3.0:1787384353.760798:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195906688 00000100:00100000:3.0:1787384353.760887:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787384353.760940:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195906688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384353.760970:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384353.760984:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340030200/0x3522fbed3b6c3405 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c33fe expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.761038:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340030200/0x3522fbed3b6c3405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c33fe expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.761060:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340030200/0x3522fbed3b6c3405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c33fe expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.761068:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030200, rc 0) 00000100:00100000:3.0:1787384353.761127:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195906688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 190us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384353.761133:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787384353.761204:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384353.761345:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384353.761373:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384353.761699:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384353.761748:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384353.761787:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8780 going to sleep for 11 seconds 00000100:00100000:0.0:1787384353.762202:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195906816 00000100:00100000:0.0:1787384353.762243:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195906816 00000100:00100000:0.0:1787384353.762276:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787384353.762284:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195906816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384353.762649:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195906816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 365us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384353.762656:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1787384353.762698:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384353.762731:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384353.762782:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384353.762809:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f79c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384353.762840:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195906944 00000100:00100000:0.0:1787384353.762918:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195906944 00000100:00100000:0.0:1787384353.762970:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787384353.762978:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195906944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384353.763166:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195906944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384353.763189:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1787384353.763246:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195906944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384353.763414:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8427:1874208195907072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384353.763447:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384353.763465:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195907072 00000100:00100000:0.0:1787384353.763469:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195907072 00000100:00100000:0.0:1787384353.763489:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787384353.763495:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:8427:x1874208195907072:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384353.763614:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:8427:x1874208195907072:12345-0@lo:502:llog_process_th.0 Request processed in 119us (166us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384353.763621:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1787384353.763650:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384353.763662:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8427:1874208195907072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384353.763681:0:8427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384353.763690:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384353.763692:0:8427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787384353.763700:0:8427:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e348611800 00000020:00000080:0.0:1787384353.763703:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787384353.764040:0:8427:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8427:1874208195907200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384353.764113:0:8427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384353.764133:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195907200 00000100:00100000:0.0:1787384353.764138:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195907200 00000100:00100000:0.0:1787384353.764159:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787384353.764165:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:8427:x1874208195907200:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384353.764287:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:8427:x1874208195907200:12345-0@lo:502:llog_process_th.0 Request processed in 122us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384353.764295:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1787384353.764331:0:8427:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384353.764343:0:8427:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:8427:1874208195907200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384353.764360:0:8427:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384353.764364:0:8427:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384353.764366:0:8427:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787384353.764371:0:8427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787384353.764414:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787384353.764428:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384353.764439:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384353.764449:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384353.804994:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384354.825271:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384354.974054:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384354.974106:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384354.974157:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384354.974195:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384354.974244:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173857408 00000100:00100000:2.0:1787384354.974268:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173857408 00000100:00100000:2.0:1787384354.974340:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173857536 00000100:00100000:2.0:1787384354.974344:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173857536 00000100:00100000:2.0:1787384354.974364:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1787384354.974374:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173857408:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384354.974469:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173857408:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 95us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384354.974477:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1787384354.974497:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:2.0:1787384354.974522:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173857536:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384354.974553:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173857536:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384354.974559:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:1.0:1787384354.974817:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173857280 00000100:00100000:1.0:1787384354.974823:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173857280 00000100:00100000:1.0:1787384354.974906:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:1.0:1787384354.974919:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173857280:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384354.974955:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173857280:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 42us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384354.974962:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00080000:1.0:1787384354.974984:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384354.974989:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384354.974992:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384354.977616:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173857152 00000100:00100000:0.0:1787384354.977633:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173857152 00000100:00100000:0.0:1787384354.977716:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 193 00000100:00100000:0.0:1787384354.977727:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:2353:x1874208173857152:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384354.977820:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:2353:x1874208173857152:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 94us (3780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384354.977846:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 193 00010000:00010000:1.0:1787384355.849672:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384356.878082:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384357.449012:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384357.449035:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195907328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384357.449100:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384357.450795:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195907328 00000100:00100000:2.0:1787384357.450807:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195907328 00000100:00100000:2.0:1787384357.450881:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787384357.450892:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195907328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384357.450927:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384357.450989:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195907328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (1888us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384357.450996:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1787384357.451019:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787384357.451694:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37275f800 x1874208195907328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384373 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384357.451900:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195907328:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384357.899138:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384357.962539:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195907840:0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.962616:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384357.962684:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787384357.962690:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195907456:0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.962723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384357.962757:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195907968:0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.962781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384357.962809:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195907584:0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.962832:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384357.962848:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195908096:0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.962890:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384357.962918:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384357.962924:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195907712:0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.962944:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384357.962974:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195907840 00000100:00100000:3.0:1787384357.962982:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195907840 00000100:00100000:3.0:1787384357.963024:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195908096 00000100:00100000:3.0:1787384357.963028:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195908096 00000100:00100000:3.0:1787384357.963054:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384357.963063:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195907840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.963117:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195907840:12345-0@lo:400:kworker.0 Request processed in 55us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384357.963124:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384357.963141:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384357.963147:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195908096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.963179:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195908096:12345-0@lo:400:kworker.0 Request processed in 33us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384357.963195:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787384357.963213:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195907968 00000100:00100000:3.0:1787384357.963217:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195907968 00000100:00100000:3.0:1787384357.963243:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195907584 00000100:00100000:3.0:1787384357.963246:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195907584 00000100:00100000:3.0:1787384357.963258:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195907712 00000100:00100000:3.0:1787384357.963261:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195907712 00000100:00100000:3.0:1787384357.963274:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787384357.963280:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195907968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.963308:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195907968:12345-0@lo:400:kworker.0 Request processed in 29us (527us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384357.963314:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787384357.963334:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787384357.963340:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195907584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.963369:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195907584:12345-0@lo:400:kworker.0 Request processed in 29us (536us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384357.963375:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787384357.963385:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787384357.963391:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195907712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.963414:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195907712:12345-0@lo:400:kworker.0 Request processed in 24us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384357.963419:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:3.0:1787384357.963447:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384357.963452:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384357.963486:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195907712:0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.963497:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195907584:0@lo:400:kworker.0 00010000:00080000:3.0:1787384357.963507:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e241332680 x1874208195908096/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384357.963517:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195908096:0@lo:400:kworker.0 00000100:00100000:3.0:1787384357.963550:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195907968:0@lo:400:kworker.0 00010000:00080000:3.0:1787384357.963560:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37275f480 x1874208195907840/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384373 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384357.963567:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195907840:0@lo:400:kworker.0 00000100:00100000:0.0:1787384357.963763:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195907456 00000100:00100000:0.0:1787384357.963768:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195907456 00000100:00100000:0.0:1787384357.963806:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787384357.963815:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195907456:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384357.963877:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195907456:12345-0@lo:400:kworker.0 Request processed in 44us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384357.963884:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1787384357.963920:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195907456:0@lo:400:kworker.0 00000100:00100000:3.0:1787384358.478683:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195908224:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384358.478756:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384358.478952:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195908224 00000100:00100000:0.0:1787384358.478961:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195908224 00000100:00100000:0.0:1787384358.479012:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787384358.479022:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195908224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384358.479062:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384358.479682:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195908224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 659us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384358.479691:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:3.0:1787384358.479781:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e3460e0380 x1874208195908224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384374 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384358.479802:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195908224:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384358.939948:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787384359.463571:0:8651:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1787384359.945201:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384360.095341:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384360.095390:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384360.095422:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384360.095461:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384360.095519:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173857920 00000100:00100000:3.0:1787384360.095529:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173857920 00000100:00100000:2.0:1787384360.095537:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173857792 00000100:00100000:2.0:1787384360.095540:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173857792 00000100:00100000:0.0:1787384360.095596:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173857664 00000100:00100000:3.0:1787384360.095598:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173858048 00000100:00100000:0.0:1787384360.095600:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173857664 00000100:00100000:3.0:1787384360.095601:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173858048 00000100:00100000:0.0:1787384360.095634:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 195 00000100:00100000:0.0:1787384360.095643:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173857664:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384360.095719:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173857664:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 77us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384360.095727:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 195 00000100:00100000:2.0:1787384360.100953:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1787384360.100980:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173857920:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384360.101084:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173857920:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 118us (5693us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384360.101092:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00080000:1.0:1787384360.103503:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384360.103514:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384360.103517:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384360.103642:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1787384360.103656:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173858048:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384360.103729:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173858048:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 77us (8267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384360.103750:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:0.0:1787384360.108021:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:0.0:1787384360.108045:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173857792:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384360.108479:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173857792:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 438us (13054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384360.108488:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00010000:00010000:2.0:1787384360.969214:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384362.001303:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384362.570658:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384362.570700:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195908352:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384362.570772:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384362.571606:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195908352 00000100:00100000:0.0:1787384362.571617:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195908352 00000100:00080000:1.0:1787384362.572087:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384362.572124:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384362.572140:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195908352:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384362.572185:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384362.572255:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195908352:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (1482us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384362.572263:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1787384362.572491:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c5ace00 x1874208195908352/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384378 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384362.572510:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195908352:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787384363.019546:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384363.082344:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195908480:0@lo:400:kworker.0 00000100:00100000:1.0:1787384363.082417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384363.084138:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195908480 00000100:00100000:0.0:1787384363.084159:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195908480 00000100:00100000:0.0:1787384363.084217:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:0.0:1787384363.084227:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195908480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384363.084297:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195908480:12345-0@lo:400:kworker.0 Request processed in 71us (1879us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384363.084303:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1787384363.084769:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195908480:0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.089959:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195908864:0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090031:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384363.090066:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384363.090072:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195908992:0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090099:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384363.090131:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195908864 00000100:00100000:2.0:1787384363.090138:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195908864 00000100:00100000:2.0:1787384363.090193:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787384363.090202:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195908864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090250:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195908864:12345-0@lo:400:kworker.0 Request processed in 49us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384363.090257:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1787384363.090299:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2bc700 x1874208195908864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384363.090312:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195908864:0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090356:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195908608:0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090382:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384363.090399:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195909120:0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384363.090434:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384363.090439:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195908736:0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090473:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384363.090531:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195908992 00000100:00100000:2.0:1787384363.090535:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195908992 00000100:00100000:2.0:1787384363.090565:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195908608 00000100:00100000:2.0:1787384363.090568:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195908608 00000100:00100000:2.0:1787384363.090577:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195908736 00000100:00100000:2.0:1787384363.090579:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195908736 00000100:00100000:2.0:1787384363.090592:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384363.090597:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195908992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090631:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195908992:12345-0@lo:400:kworker.0 Request processed in 33us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384363.090637:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384363.090649:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787384363.090656:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195908608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090697:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195908608:12345-0@lo:400:kworker.0 Request processed in 41us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384363.090702:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787384363.090712:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787384363.090718:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195908736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090741:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195908736:12345-0@lo:400:kworker.0 Request processed in 23us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384363.090745:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787384363.090773:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195908992:0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090794:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195908736:0@lo:400:kworker.0 00000100:00100000:2.0:1787384363.090802:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195908608:0@lo:400:kworker.0 00000100:00100000:1.0:1787384363.093064:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195909120 00000100:00100000:1.0:1787384363.093078:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195909120 00000100:00100000:1.0:1787384363.093160:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384363.093175:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195909120:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384363.093266:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195909120:12345-0@lo:400:kworker.0 Request processed in 98us (2846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384363.093274:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1787384363.093296:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384363.093301:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787384363.093364:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2bf100 x1874208195909120/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384379 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384363.093379:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195909120:0@lo:400:kworker.0 00000100:00100000:3.0:1787384363.604844:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195909248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384363.604934:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384363.605026:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195909248 00000100:00100000:3.0:1787384363.605033:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195909248 00000100:00100000:3.0:1787384363.605081:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787384363.605090:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195909248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384363.605130:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384363.605182:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241333480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195909248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384363.605207:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:3.0:1787384363.605255:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e241333b80 x1874208195909248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384379 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384363.605274:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241333b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195909248:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787384364.043435:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384365.065458:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384365.221815:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384365.221929:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384365.221961:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173858304 00000100:00100000:3.0:1787384365.221970:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173858304 00000100:00100000:3.0:1787384365.222031:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:3.0:1787384365.222042:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173858304:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384365.222368:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173858304:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 327us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384365.222376:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00080000:3.0:1787384365.222399:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384365.222428:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384365.222500:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384365.222523:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173858432 00000100:00100000:3.0:1787384365.222527:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173858432 00000100:00100000:3.0:1787384365.222556:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173858560 00000100:00100000:3.0:1787384365.222559:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173858560 00000100:00100000:3.0:1787384365.222573:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:3.0:1787384365.222580:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2349:x1874208173858432:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:3.0:1787384365.222614:0:6575:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3341 00000100:00080000:3.0:1787384365.222624:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89e37b8f3000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787384365.222682:0:6575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787384365.223022:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+2:2349:x1874208173858432:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 441us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384365.223044:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:3.0:1787384365.223060:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:3.0:1787384365.223066:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2349:x1874208173858560:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:3.0:1787384365.223081:0:6575:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3348 00000100:00080000:3.0:1787384365.223087:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89e37b8f0800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787384365.223108:0:6575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787384365.223289:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+2:2349:x1874208173858560:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 222us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384365.223296:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00010000:00010000:3.0:1787384365.223373:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384365.223380:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787384365.223386:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787384365.223388:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384365.223952:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173858176 00000100:00100000:0.0:1787384365.223959:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173858176 00000100:00100000:0.0:1787384365.224000:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 197 00000100:00100000:0.0:1787384365.224008:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173858176:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384365.224051:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173858176:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 45us (2246us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384365.224057:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 197 00000001:02000400:1.0:1787384365.822720:0:8895:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing yml_node 00010000:00010000:3.0:1787384366.089251:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384367.123208:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384367.691241:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384367.691264:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195909376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384367.691342:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384367.691572:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195909376 00000100:00100000:1.0:1787384367.691580:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195909376 00000100:00100000:1.0:1787384367.691643:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384367.691656:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195909376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384367.691710:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787384367.692068:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384367.692945:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195909376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1288us (1597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384367.692956:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1787384367.714143:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e2410aaa00 x1874208195909376/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384383 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384367.714174:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195909376:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787384368.137140:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384368.201447:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195909632:0@lo:400:kworker.0 00000100:00100000:3.0:1787384368.201515:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384368.201574:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195910144:0@lo:400:kworker.0 00000100:00100000:3.0:1787384368.201600:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384368.201632:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384368.201638:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195909760:0@lo:400:kworker.0 00000100:00100000:3.0:1787384368.201660:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384368.201710:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195910144 00000100:00100000:3.0:1787384368.201718:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195910144 00000100:00100000:3.0:1787384368.201774:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787384368.201783:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195910144:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384368.201849:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195910144:12345-0@lo:400:kworker.0 Request processed in 67us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384368.201857:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787384368.201901:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195909632 00000100:00100000:3.0:1787384368.201904:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195909632 00000100:00100000:3.0:1787384368.201926:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195909760 00000100:00100000:3.0:1787384368.201929:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195909760 00000100:00100000:3.0:1787384368.201948:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384368.201954:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195909632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384368.201985:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195909632:12345-0@lo:400:kworker.0 Request processed in 31us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384368.201991:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384368.202001:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787384368.202007:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195909760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384368.202032:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195909760:12345-0@lo:400:kworker.0 Request processed in 25us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384368.202037:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1787384368.202066:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384368.202070:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384368.202095:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195909760:0@lo:400:kworker.0 00000100:00100000:3.0:1787384368.202104:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195909632:0@lo:400:kworker.0 00010000:00080000:3.0:1787384368.202126:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2be300 x1874208195910144/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384368.202150:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195910144:0@lo:400:kworker.0 00000100:00100000:0.0:1787384368.202467:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195909504:0@lo:400:kworker.0 00000100:00100000:0.0:1787384368.202505:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384368.202551:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195910016:0@lo:400:kworker.0 00000100:00100000:0.0:1787384368.202574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384368.202591:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384368.202596:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195909888:0@lo:400:kworker.0 00000100:00100000:0.0:1787384368.202615:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384368.204150:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195910016 00000100:00100000:2.0:1787384368.204165:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195910016 00000100:00100000:2.0:1787384368.204246:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384368.204256:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195910016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384368.204343:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195910016:12345-0@lo:400:kworker.0 Request processed in 89us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384368.204351:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1787384368.204768:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384368.204822:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195910016:0@lo:400:kworker.0 00000100:00100000:3.0:1787384368.205151:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195909504 00000100:00100000:3.0:1787384368.205157:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195909504 00000100:00100000:3.0:1787384368.205214:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787384368.205223:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195909504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384368.205275:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195909504:12345-0@lo:400:kworker.0 Request processed in 54us (2769us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384368.205292:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1787384368.205337:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195909888 00000100:00100000:3.0:1787384368.205340:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195909888 00000100:00100000:3.0:1787384368.205445:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787384368.205452:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195909888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384368.205486:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195909888:12345-0@lo:400:kworker.0 Request processed in 35us (2870us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384368.205493:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1787384368.205978:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2bf100 x1874208195909888/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384368.205993:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195909888:0@lo:400:kworker.0 00000100:00100000:2.0:1787384368.206004:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195909504:0@lo:400:kworker.0 00000100:00100000:0.0:1787384368.714013:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195910272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384368.714247:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384368.720410:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195910272 00000100:00100000:3.0:1787384368.720425:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195910272 00000100:00100000:3.0:1787384368.720501:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787384368.720513:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195910272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384368.720551:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384368.721246:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195910272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 733us (6997us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384368.721256:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787384368.724503:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e241331500 x1874208195910272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384384 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384368.724534:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195910272:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384369.163458:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787384369.317948:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:3.0:1787384369.317974:0:7483:0:(genops.c:906:class_export_put()) final put ffff89e37b8f6000/ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:1.0:1787384369.318066:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37b8f6000/ddc9253f-47aa-4509-981d-645f91ec7250 for lustre-OST0001 00000020:00000080:1.0:1787384369.318127:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e37b8f0800 for lustre-OST0001 00000001:00100000:3.0:1787384369.850896:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:3.0:1787384369.850906:0:6600:0:(genops.c:906:class_export_put()) final put ffff89e37b8f7000/ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:0.0:1787384369.851075:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37b8f7000/ddc9253f-47aa-4509-981d-645f91ec7250 for lustre-OST0000 00000020:00000080:0.0:1787384369.851134:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e37b8f3000 for lustre-OST0000 00010000:00010000:3.0:1787384370.186135:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384370.339091:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384370.339176:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384370.339373:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173858688 00000100:00100000:2.0:1787384370.339387:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173858688 00000100:00100000:2.0:1787384370.339459:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 199 00000100:00100000:2.0:1787384370.339470:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:2352:x1874208173858688:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384370.339556:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:2352:x1874208173858688:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 89us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384370.339564:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 199 00000100:00100000:1.0:1787384370.340258:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173858816 00000100:00100000:1.0:1787384370.340265:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173858816 00000100:00100000:1.0:1787384370.340337:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:1.0:1787384370.340352:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173858816:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384370.340571:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173858816:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 223us (1502us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384370.340580:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00080000:0.0:1787384370.341252:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787384371.210576:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787384371.789115:0:9088:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.113 00010000:00010000:3.0:1787384372.233425:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384372.810119:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384372.810161:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195910400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384372.810253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384372.810480:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195910400 00000100:00100000:1.0:1787384372.810490:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195910400 00000100:00100000:1.0:1787384372.810573:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787384372.810584:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195910400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384372.810629:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384372.810686:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195910400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384372.810694:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:0.0:1787384372.810853:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787384372.810925:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e2410aa300 x1874208195910400/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384388 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384372.810945:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195910400:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787384373.257399:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384373.321246:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195910784:0@lo:400:kworker.0 00000100:00100000:3.0:1787384373.321292:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195910912:0@lo:400:kworker.0 00000100:00100000:0.0:1787384373.321351:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.321352:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.321450:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787384373.321458:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195910656:0@lo:400:kworker.0 00000100:00100000:0.0:1787384373.321482:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384373.321504:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195911168:0@lo:400:kworker.0 00000100:00100000:0.0:1787384373.321530:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.321531:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787384373.321541:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195910528:0@lo:400:kworker.0 00000100:00100000:0.0:1787384373.321569:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195910784 00000100:00100000:0.0:1787384373.321578:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195910784 00000100:00100000:3.0:1787384373.321580:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.321684:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195911040:0@lo:400:kworker.0 00000100:00100000:3.0:1787384373.321711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.321741:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195910656 00000100:00100000:3.0:1787384373.321745:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195910656 00000100:00100000:2.0:1787384373.321755:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195911040 00000100:00100000:2.0:1787384373.321761:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195911040 00000100:00080000:1.0:1787384373.321911:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384373.321929:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195910912 00000100:00100000:1.0:1787384373.321933:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195910912 00000100:00100000:1.0:1787384373.321968:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195911168 00000100:00100000:1.0:1787384373.321971:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195911168 00000100:00100000:1.0:1787384373.321993:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384373.322011:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195910912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384373.322091:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195910912:12345-0@lo:400:kworker.0 Request processed in 82us (742us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.322098:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384373.322120:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384373.322127:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195911168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384373.322162:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195911168:12345-0@lo:400:kworker.0 Request processed in 36us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384373.322167:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:1.0:1787384373.322181:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787384373.322211:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e3460e2300 x1874208195910912/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384373.322227:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195910912:0@lo:400:kworker.0 00000100:00100000:3.0:1787384373.329343:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384373.329381:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195910784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384373.329515:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195910784:12345-0@lo:400:kworker.0 Request processed in 153us (8168us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384373.329524:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384373.329553:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384373.329561:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195910656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384373.329593:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195910656:12345-0@lo:400:kworker.0 Request processed in 33us (8110us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384373.329621:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384373.329666:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195910528 00000100:00100000:3.0:1787384373.329676:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195910528 00000100:00100000:3.0:1787384373.329728:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787384373.329736:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195910528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384373.329782:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195910528:12345-0@lo:400:kworker.0 Request processed in 47us (8203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384373.329789:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1787384373.330304:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195910656:0@lo:400:kworker.0 00010000:00080000:3.0:1787384373.330326:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e3460e2d80 x1874208195911168/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384373.330338:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195911168:0@lo:400:kworker.0 00000100:00100000:3.0:1787384373.330352:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195910784:0@lo:400:kworker.0 00000100:00100000:3.0:1787384373.330409:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195910528:0@lo:400:kworker.0 00000100:00100000:3.0:1787384373.332642:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787384373.332684:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195911040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384373.332816:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195911040:12345-0@lo:400:kworker.0 Request processed in 150us (11102us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384373.332825:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787384373.332916:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195911040:0@lo:400:kworker.0 00000100:00100000:1.0:1787384373.835638:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384373.835677:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195911296:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384373.835772:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384373.836119:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195911296 00000100:00100000:3.0:1787384373.836131:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195911296 00000100:00100000:3.0:1787384373.836203:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787384373.836232:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195911296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384373.836280:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384373.836339:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195911296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384373.836347:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1787384373.836538:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e241331500 x1874208195911296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384389 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384373.836562:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195911296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384374.289327:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787384374.446354:0:9186:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.113 00010000:00010000:3.0:1787384375.314152:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384375.461629:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384375.461686:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384375.461795:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173859072 00000100:00100000:0.0:1787384375.461808:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173859072 00000100:00100000:0.0:1787384375.461919:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:0.0:1787384375.461932:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173859072:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384375.462027:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173859072:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 98us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384375.462036:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00080000:0.0:1787384375.462071:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384375.462426:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173858944 00000100:00100000:3.0:1787384375.462432:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173858944 00000100:00100000:3.0:1787384375.462474:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 201 00000100:00100000:3.0:1787384375.462483:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173858944:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384375.462526:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173858944:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 44us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384375.462533:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 201 00010000:00010000:1.0:1787384376.329341:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787384377.030181:0:9283:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.113 00010000:00010000:3.0:1787384377.353404:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384377.932804:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384377.932845:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195911424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384377.932995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384377.933213:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195911424 00000100:00100000:1.0:1787384377.933225:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195911424 00000100:00100000:1.0:1787384377.933319:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384377.933331:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195911424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384377.933377:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384377.933432:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195911424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384377.933440:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787384377.933528:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384377.934117:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e2410a9180 x1874208195911424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384393 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384377.934154:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195911424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787384378.385018:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384378.441703:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195911936:0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.441795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384378.441886:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1787384378.441893:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195911552:0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.441925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384378.441948:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195912064:0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.441973:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384378.442001:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195911680:0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.442025:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384378.442057:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384378.442074:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195911808:0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.442097:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384378.442133:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195911552 00000100:00100000:3.0:1787384378.442142:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195911552 00000100:00100000:3.0:1787384378.442211:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787384378.442221:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195911552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.442282:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195911552:12345-0@lo:400:kworker.0 Request processed in 61us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384378.442291:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1787384378.442331:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195912064 00000100:00100000:3.0:1787384378.442335:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195912064 00000100:00100000:3.0:1787384378.442378:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787384378.442385:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195912064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.442431:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195912064:12345-0@lo:400:kworker.0 Request processed in 47us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384378.442438:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787384378.442456:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195911936 00000100:00100000:3.0:1787384378.442460:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195911936 00000100:00100000:3.0:1787384378.442485:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195911680 00000100:00100000:3.0:1787384378.442487:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195911680 00000100:00100000:3.0:1787384378.442498:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195911808 00000100:00100000:3.0:1787384378.442501:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195911808 00000100:00100000:3.0:1787384378.442515:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787384378.442522:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195911936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.442552:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195911936:12345-0@lo:400:kworker.0 Request processed in 31us (758us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384378.442559:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787384378.442570:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787384378.442584:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195911680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.442618:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195911680:12345-0@lo:400:kworker.0 Request processed in 34us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384378.442624:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787384378.442635:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787384378.442641:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195911808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.442666:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195911808:12345-0@lo:400:kworker.0 Request processed in 25us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384378.442671:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1787384378.442690:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384378.442695:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384378.442734:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195911808:0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.442746:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195911680:0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.442777:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195911552:0@lo:400:kworker.0 00010000:00080000:3.0:1787384378.442789:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c5ace00 x1874208195912064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384378.442800:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195912064:0@lo:400:kworker.0 00000100:00100000:3.0:1787384378.442809:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195911936:0@lo:400:kworker.0 00000001:02000400:1.0:1787384378.904638:0:9331:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sat Aug 22 03:39:36 EDT 2026 00000100:00100000:3.0:1787384378.955689:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195912192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384378.955787:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384378.955915:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195912192 00000100:00100000:3.0:1787384378.955923:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195912192 00000100:00100000:3.0:1787384378.955971:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787384378.955981:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195912192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384378.956029:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384378.959223:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195912192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3235us (3431us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384378.959237:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1787384378.959347:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37275ea00 x1874208195912192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384394 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384378.959379:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195912192:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384379.401680:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384380.426772:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384380.579214:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384380.579270:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384380.579310:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173859328 00000100:00100000:0.0:1787384380.579319:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173859328 00000100:00100000:0.0:1787384380.579384:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:0.0:1787384380.579394:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173859328:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384380.579467:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173859328:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 74us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384380.579474:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00080000:0.0:1787384380.579502:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384380.579886:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173859200 00000100:00100000:1.0:1787384380.579892:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173859200 00000100:00100000:1.0:1787384380.579932:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 203 00000100:00100000:1.0:1787384380.579940:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173859200:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384380.579979:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173859200:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 40us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384380.579985:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 203 00010000:00010000:3.0:1787384381.450483:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384382.473684:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384383.049887:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195912320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384383.049972:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384383.050143:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195912320 00000100:00100000:3.0:1787384383.050151:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195912320 00000100:00100000:3.0:1787384383.050223:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787384383.050233:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195912320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384383.050268:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787384383.050416:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384383.050729:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195912320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 496us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384383.050738:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:2.0:1787384383.050813:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e2410aad80 x1874208195912320/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384399 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384383.050833:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195912320:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787384383.497176:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384383.561566:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195912832:0@lo:400:kworker.0 00000100:00100000:3.0:1787384383.561661:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384383.561725:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384383.561732:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195912704:0@lo:400:kworker.0 00000100:00100000:3.0:1787384383.561766:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384383.561799:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195912832 00000100:00100000:3.0:1787384383.561806:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195912832 00000100:00100000:3.0:1787384383.561888:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195912704 00000100:00100000:3.0:1787384383.561892:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195912704 00000100:00100000:3.0:1787384383.561930:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787384383.561939:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195912832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384383.561990:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195912832:12345-0@lo:400:kworker.0 Request processed in 52us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384383.561998:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787384383.562025:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787384383.562031:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195912704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384383.562059:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195912704:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384383.562065:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787384383.562089:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384383.562119:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195912704:0@lo:400:kworker.0 00000100:00100000:3.0:1787384383.562131:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195912832:0@lo:400:kworker.0 00000100:00100000:0.0:1787384383.562219:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195912448:0@lo:400:kworker.0 00000100:00100000:0.0:1787384383.562257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384383.562286:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195912960:0@lo:400:kworker.0 00000100:00100000:0.0:1787384383.562311:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384383.562329:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384383.562334:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195912576:0@lo:400:kworker.0 00000100:00100000:0.0:1787384383.562354:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384383.562670:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195912448 00000100:00100000:3.0:1787384383.562676:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195912448 00000100:00100000:3.0:1787384383.562713:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1787384383.562722:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195912448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384383.562929:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195912960 00000100:00100000:1.0:1787384383.562934:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195912960 00000100:00100000:1.0:1787384383.562981:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787384383.562993:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195912960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384383.563046:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195912960:12345-0@lo:400:kworker.0 Request processed in 58us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384383.563053:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1787384383.563091:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37273d880 x1874208195912960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384399 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384383.563104:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195912960:0@lo:400:kworker.0 00000100:00100000:1.0:1787384383.563133:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195912576 00000100:00100000:1.0:1787384383.563137:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195912576 00000100:00100000:1.0:1787384383.563162:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787384383.563169:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195912576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384383.563208:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195912576:12345-0@lo:400:kworker.0 Request processed in 41us (853us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384383.563214:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787384383.563256:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195912576:0@lo:400:kworker.0 00000100:00100000:3.0:1787384383.563559:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195912448:12345-0@lo:400:kworker.0 Request processed in 837us (1300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384383.563567:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:0.0:1787384383.563640:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384383.563989:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195912448:0@lo:400:kworker.0 00000100:00100000:0.0:1787384384.073074:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384384.073098:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195913088:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384384.073170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384384.073339:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195913088 00000100:00100000:3.0:1787384384.073360:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195913088 00000100:00100000:3.0:1787384384.073414:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384384.073424:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195913088:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384384.073478:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384384.073525:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195913088:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384384.073532:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1787384384.073676:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379ee9180 x1874208195913088/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384384.073695:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195913088:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384384.534173:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384385.552273:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384385.697626:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384385.697683:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384385.701122:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173859584 00000100:00100000:1.0:1787384385.701136:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173859584 00000100:00100000:1.0:1787384385.701210:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:1.0:1787384385.701224:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173859584:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384385.701308:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173859584:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 89us (3694us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384385.701316:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00080000:1.0:1787384385.701365:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384385.701924:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173859456 00000100:00100000:1.0:1787384385.701931:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173859456 00000100:00100000:1.0:1787384385.701966:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 205 00000100:00100000:1.0:1787384385.701974:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:2351:x1874208173859456:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384385.702023:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+10:2351:x1874208173859456:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 50us (4340us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384385.702030:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 205 00010000:00010000:3.0:1787384386.569558:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384387.593072:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384388.181047:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195913216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384388.181126:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384388.181357:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195913216 00000100:00100000:1.0:1787384388.181368:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195913216 00000100:00100000:1.0:1787384388.181446:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384388.181462:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195913216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384388.181500:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384388.181570:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195913216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384388.181578:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1787384388.181613:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787384388.182214:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e2410a9f80 x1874208195913216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384404 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384388.182235:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195913216:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787384388.619735:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384388.681613:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195913472:0@lo:400:kworker.0 00000100:00100000:3.0:1787384388.681753:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384388.681770:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195913728:0@lo:400:kworker.0 00000100:00100000:1.0:1787384388.681811:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384388.681822:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384388.681832:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195913600:0@lo:400:kworker.0 00000100:00100000:1.0:1787384388.681849:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787384388.681884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384388.681913:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195913472 00000100:00100000:3.0:1787384388.681920:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195913472 00000100:00100000:1.0:1787384388.681952:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195913344:0@lo:400:kworker.0 00000100:00100000:3.0:1787384388.681985:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195913728 00000100:00100000:3.0:1787384388.681990:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195913728 00000100:00100000:1.0:1787384388.682002:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384388.682018:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195913600 00000100:00100000:3.0:1787384388.682023:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195913600 00000100:00100000:1.0:1787384388.682036:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195913856:0@lo:400:kworker.0 00000100:00100000:3.0:1787384388.682045:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787384388.682055:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195913472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384388.682067:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384388.682107:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787384388.682115:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195913472:12345-0@lo:400:kworker.0 Request processed in 61us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384388.682123:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195913728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384388.682128:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787384388.682150:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787384388.682158:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195913600:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384388.682171:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195913728:12345-0@lo:400:kworker.0 Request processed in 55us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384388.682180:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787384388.682207:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195913344 00000100:00100000:3.0:1787384388.682209:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eeb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195913600:12345-0@lo:400:kworker.0 Request processed in 51us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384388.682212:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195913344 00000100:00100000:3.0:1787384388.682220:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1787384388.682248:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00080000:3.0:1787384388.682251:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384388.682258:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195913344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384388.682266:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195913856 00000100:00100000:3.0:1787384388.682271:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195913856 00000100:00100000:1.0:1787384388.682293:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195913344:12345-0@lo:400:kworker.0 Request processed in 37us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384388.682300:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:3.0:1787384388.682310:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384388.682318:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195913856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384388.682358:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195913856:12345-0@lo:400:kworker.0 Request processed in 41us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384388.682366:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195913344:0@lo:400:kworker.0 00000100:00100000:3.0:1787384388.682367:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787384388.682387:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37bbd8700 x1874208195913856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384404 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787384388.682393:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384388.682401:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195913856:0@lo:400:kworker.0 00000100:00100000:3.0:1787384388.682419:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195913600:0@lo:400:kworker.0 00000100:00100000:1.0:1787384388.682431:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195913728:0@lo:400:kworker.0 00000100:00100000:3.0:1787384388.682437:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195913472:0@lo:400:kworker.0 00000100:00100000:1.0:1787384389.199193:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384389.199220:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195913984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384389.199290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384389.199391:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195913984 00000100:00100000:2.0:1787384389.199399:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195913984 00000100:00100000:2.0:1787384389.199446:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384389.199456:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195913984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384389.199489:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384389.199549:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195913984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384389.199556:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1787384389.199684:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2be680 x1874208195913984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384405 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384389.199700:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195913984:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787384389.650783:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384390.669478:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384390.815379:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384390.815907:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173859712 00000100:00100000:1.0:1787384390.815917:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173859712 00000100:00100000:1.0:1787384390.815985:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 207 00000100:00100000:1.0:1787384390.815996:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:2353:x1874208173859712:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384390.816074:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:2353:x1874208173859712:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 80us (704us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384390.816081:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 207 00000100:00100000:1.0:1787384390.826171:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384390.827406:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173859840 00000100:00100000:2.0:1787384390.827418:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173859840 00000100:00100000:2.0:1787384390.827503:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:2.0:1787384390.827515:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173859840:12345-192.168.203.51@tcp:400:kworker.0 00000100:00080000:3.0:1787384390.827532:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384390.827597:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173859840:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 84us (1434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384390.827617:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00010000:00010000:2.0:1787384391.695469:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384392.720072:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384393.294144:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384393.294166:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195914112:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384393.294233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384393.294310:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195914112 00000100:00100000:2.0:1787384393.294318:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195914112 00000100:00100000:2.0:1787384393.294382:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787384393.294392:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195914112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384393.294428:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384393.294491:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195914112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.294498:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787384393.294516:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384393.294540:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2be300 x1874208195914112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384409 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384393.294557:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195914112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787384393.737040:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384393.807724:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195914240:0@lo:400:kworker.0 00000100:00100000:1.0:1787384393.807965:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384393.808157:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195914368:0@lo:400:kworker.0 00000100:00100000:0.0:1787384393.808208:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384393.808254:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195914368 00000100:00100000:0.0:1787384393.808261:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195914368 00000100:00100000:0.0:1787384393.808308:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787384393.808317:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195914368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384393.808369:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbda680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195914368:12345-0@lo:400:kworker.0 Request processed in 53us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384393.808377:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787384393.808418:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eea680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195914368:0@lo:400:kworker.0 00000100:00100000:2.0:1787384393.812264:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195914240 00000100:00100000:2.0:1787384393.812278:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195914240 00000100:00100000:2.0:1787384393.812340:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1787384393.812349:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195914240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384393.812918:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384393.812931:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195914496:0@lo:400:kworker.0 00000100:00100000:3.0:1787384393.812982:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384393.813022:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195914496 00000100:00100000:3.0:1787384393.813027:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195914496 00000100:00100000:3.0:1787384393.813065:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787384393.813072:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195914496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384393.813111:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195914496:12345-0@lo:400:kworker.0 Request processed in 40us (129us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384393.813117:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1787384393.813156:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384393.813187:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195914496:0@lo:400:kworker.0 00000100:00100000:3.0:1787384393.813228:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195914624:0@lo:400:kworker.0 00000100:00100000:3.0:1787384393.813253:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384393.813348:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384393.813358:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195914752:0@lo:400:kworker.0 00000100:00100000:0.0:1787384393.813391:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384393.813428:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195914624 00000100:00100000:0.0:1787384393.813442:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195914624 00000100:00100000:0.0:1787384393.813486:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787384393.813493:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195914624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384393.813530:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eeaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195914624:12345-0@lo:400:kworker.0 Request processed in 38us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384393.813537:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1787384393.813553:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384393.813570:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eea300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195914624:0@lo:400:kworker.0 00000100:00100000:3.0:1787384393.815897:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195914752 00000100:00100000:3.0:1787384393.815909:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195914752 00000100:00100000:3.0:1787384393.815989:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787384393.815999:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195914752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384393.816077:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195914752:12345-0@lo:400:kworker.0 Request processed in 80us (2684us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384393.816085:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787384393.816571:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787384393.816610:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379ee8380 x1874208195914752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384393.816624:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379ee8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195914752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384393.817625:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195914240:12345-0@lo:400:kworker.0 Request processed in 5271us (9655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384393.817636:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1787384393.817924:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379ee8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195914240:0@lo:400:kworker.0 00000100:00100000:1.0:1787384394.315767:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384394.315842:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195914880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384394.316447:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384394.316660:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195914880 00000100:00100000:2.0:1787384394.316680:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195914880 00000100:00100000:2.0:1787384394.316734:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787384394.316743:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195914880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384394.316775:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384394.316896:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195914880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384394.316904:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1787384394.317633:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2be300 x1874208195914880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384410 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384394.317656:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195914880:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787384394.761345:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787384395.341366:0:9961:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 03:39:52 (1787384392) === 00010000:00010000:2.0:1787384395.785229:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384395.888830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384395.889074:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173859968 00000100:00100000:1.0:1787384395.889084:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173859968 00000100:00100000:1.0:1787384395.889146:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 209 00000100:00100000:1.0:1787384395.889167:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:8098:x1874208173859968:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787384395.889183:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384395.889200:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624c000/0x3522fbed3b6c340c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78c4f expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384395.889227:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624c000/0x3522fbed3b6c340c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c4f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384395.889238:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624c000/0x3522fbed3b6c340c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c4f expref: 11 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384395.889247:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c000, rc 0) 00000100:00100000:1.0:1787384395.889309:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+11:8098:x1874208173859968:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 145us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384395.889316:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 209 00000100:00100000:3.0:1787384395.901028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384395.901286:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173860096 00000100:00100000:2.0:1787384395.901296:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173860096 00000100:00100000:2.0:1787384395.901364:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 210 00000100:00100000:2.0:1787384395.901374:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+11:8098:x1874208173860096:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787384395.901669:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+11:8098:x1874208173860096:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 294us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384395.901677:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 210 00000100:00100000:2.0:1787384395.909528:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384395.909638:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173860224 00000100:00100000:0.0:1787384395.909648:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173860224 00000100:00100000:0.0:1787384395.909713:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 211 00000100:00100000:0.0:1787384395.909721:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+11:8098:x1874208173860224:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787384395.910289:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+11:8098:x1874208173860224:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 565us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384395.910299:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 211 00000100:00100000:3.0:1787384395.921745:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384395.921918:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173860352 00000100:00100000:1.0:1787384395.921945:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173860352 00000100:00100000:1.0:1787384395.922013:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 212 00000100:00100000:1.0:1787384395.922024:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+11:8102:x1874208173860352:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384395.922499:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+11:8102:x1874208173860352:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 475us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384395.922508:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 212 00000100:00100000:0.0:1787384395.937212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384395.937308:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173860480 00000100:00100000:3.0:1787384395.937322:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173860480 00000100:00100000:3.0:1787384395.937419:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:3.0:1787384395.937432:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173860480:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384395.937549:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173860480:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 119us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384395.937576:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00080000:0.0:1787384395.937759:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384395.950113:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384395.952213:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173860608 00000100:00100000:1.0:1787384395.952227:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173860608 00000100:00100000:1.0:1787384395.952302:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 213 00000100:00100000:1.0:1787384395.952314:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+11:8102:x1874208173860608:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384395.952617:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+11:8102:x1874208173860608:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 305us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384395.952626:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 213 00000100:00100000:3.0:1787384395.957445:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384395.957881:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173860736 00000100:00100000:1.0:1787384395.957897:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173860736 00000100:00100000:1.0:1787384395.957975:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 214 00000100:00100000:1.0:1787384395.957986:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+11:8098:x1874208173860736:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787384395.958002:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384395.958019:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624c200/0x3522fbed3b6c3413 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78c79 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384395.958252:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624c200/0x3522fbed3b6c3413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c79 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384395.958266:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624c200/0x3522fbed3b6c3413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c79 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384395.958275:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c200, rc 0) 00000100:00100000:1.0:1787384395.958342:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+12:8098:x1874208173860736:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 358us (912us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384395.958349:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 214 00000100:00100000:0.0:1787384395.965618:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384395.965762:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173860864 00000100:00100000:1.0:1787384395.965772:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173860864 00000100:00100000:3.0:1787384395.966018:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 215 00000100:00100000:3.0:1787384395.966032:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+12:8098:x1874208173860864:12345-192.168.203.51@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787384395.966123:0:5778:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787384395.966149:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787384395.966154:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787384395.966157:0:5778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787384395.966159:0:5778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1787384395.970284:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+12:8098:x1874208173860864:12345-192.168.203.51@tcp:256:mount.lustre.0 Request processed in 4245us (4665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384395.970300:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 215 00000100:00100000:0.0:1787384395.980392:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384395.980514:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173860992 00000100:00100000:1.0:1787384395.980524:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173860992 00000100:00100000:1.0:1787384395.980593:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 216 00000100:00100000:1.0:1787384395.980604:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+12:8098:x1874208173860992:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787384395.980977:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384395.980997:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624ca00/0x3522fbed3b6c341a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78c80 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384395.981027:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624ca00/0x3522fbed3b6c341a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c80 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384395.981039:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624ca00/0x3522fbed3b6c341a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c80 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384395.981059:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624ca00, rc 0) 00000100:00100000:1.0:1787384395.981120:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:8098:x1874208173860992:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 518us (738us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384395.981126:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 216 00000100:00100000:3.0:1787384395.983518:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384395.983603:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173861120 00000100:00100000:0.0:1787384395.983612:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173861120 00000100:00100000:0.0:1787384395.983792:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 217 00000100:00100000:0.0:1787384395.986297:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:8098:x1874208173861120:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787384395.987326:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:8098:x1874208173861120:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 3517us (3807us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384395.987338:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 217 00000100:00100000:3.0:1787384395.996660:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384395.996797:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173861248 00000100:00100000:2.0:1787384395.996815:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173861248 00000100:00100000:2.0:1787384395.996898:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 218 00000100:00100000:2.0:1787384395.996909:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:8098:x1874208173861248:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787384395.997147:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:8098:x1874208173861248:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 238us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384395.997164:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 218 00000100:00100000:2.0:1787384396.015313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384396.015405:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173861376 00000100:00100000:3.0:1787384396.015416:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173861376 00000100:00100000:3.0:1787384396.015481:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 219 00000100:00100000:3.0:1787384396.015491:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:8104:x1874208173861376:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384396.016397:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:8104:x1874208173861376:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 903us (1090us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384396.016407:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 219 00000100:00100000:3.0:1787384396.022222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384396.022310:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173861504 00000100:00100000:2.0:1787384396.022319:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173861504 00000100:00100000:2.0:1787384396.022370:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 220 00000100:00100000:2.0:1787384396.022379:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:8104:x1874208173861504:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787384396.022626:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:8104:x1874208173861504:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 247us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384396.022634:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 220 00000100:00100000:2.0:1787384396.035438:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384396.046217:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173861632 00000100:00100000:0.0:1787384396.046235:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173861632 00000100:00100000:1.0:1787384396.056011:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:1.0:1787384396.056032:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2349:x1874208173861632:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787384396.056065:0:7691:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 5b85b8ac-6b36-499b-99d6-8bdc07d5605c@192.168.203.51@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1787384396.056114:0:7691:0:(genops.c:1406:class_connect()) connect: client 5b85b8ac-6b36-499b-99d6-8bdc07d5605c, cookie 0x3522fbed3b6c3421 00000004:00100000:1.0:1787384396.056167:0:7691:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1787384396.056428:0:7691:0:(import.c:65:import_set_state_nolock()) ffff89e37293a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384396.056710:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2349:x1874208173861632:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 687us (21295us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384396.056718:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:0.0:1787384396.067526:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384396.067720:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173861760 00000100:00100000:3.0:1787384396.067730:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173861760 00000100:00100000:2.0:1787384396.067962:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384396.068686:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173861888 00000100:00100000:3.0:1787384396.068691:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173861888 00000100:00100000:3.0:1787384396.068719:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:3.0:1787384396.068728:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+7:0:x1874208173861760:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384396.068770:0:5783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787384396.068964:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbdaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+7:0:x1874208173861760:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 235us (1446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384396.068972:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:3.0:1787384396.068998:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:3.0:1787384396.069005:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:8098:x1874208173861888:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384396.069016:0:5783:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787384396.069038:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:8098:x1874208173861888:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 34us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384396.069188:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1787384396.073574:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384396.073839:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173862016 00000100:00100000:1.0:1787384396.073848:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173862016 00000100:00100000:1.0:1787384396.073948:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:1.0:1787384396.073958:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:8098:x1874208173862016:12345-192.168.203.51@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787384396.074061:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eeca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:8098:x1874208173862016:12345-192.168.203.51@tcp:40:mount.lustre.0 Request processed in 104us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384396.074070:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00080000:0.0:1787384396.074652:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384396.078180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384396.078217:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384396.078249:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384396.078330:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173862144 00000100:00100000:2.0:1787384396.078338:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173862144 00000100:00100000:2.0:1787384396.078375:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173862272 00000100:00100000:2.0:1787384396.078377:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173862272 00000100:00100000:2.0:1787384396.078388:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1787384396.078396:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874208173862144:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787384396.078425:0:6576:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 5b85b8ac-6b36-499b-99d6-8bdc07d5605c@192.168.203.51@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1787384396.078455:0:6576:0:(genops.c:1406:class_connect()) connect: client 5b85b8ac-6b36-499b-99d6-8bdc07d5605c, cookie 0x3522fbed3b6c3428 00002000:00100000:2.0:1787384396.078466:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5b85b8ac-6b36-499b-99d6-8bdc07d5605c/ffff89e3441a1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787384396.078489:0:6576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787384396.078694:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787384396.078722:0:6576:0:(import.c:65:import_set_state_nolock()) ffff89e3441a0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384396.078784:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2349:x1874208173862144:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 387us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384396.078804:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1787384396.078821:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:2.0:1787384396.078825:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874208173862272:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787384396.078839:0:6576:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 5b85b8ac-6b36-499b-99d6-8bdc07d5605c@192.168.203.51@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1787384396.078894:0:6576:0:(genops.c:1406:class_connect()) connect: client 5b85b8ac-6b36-499b-99d6-8bdc07d5605c, cookie 0x3522fbed3b6c342f 00002000:00100000:2.0:1787384396.078900:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5b85b8ac-6b36-499b-99d6-8bdc07d5605c/ffff89e3441a5000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787384396.078914:0:6576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787384396.079072:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787384396.079086:0:6576:0:(import.c:65:import_set_state_nolock()) ffff89e3441a2000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384396.079107:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eeb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2349:x1874208173862272:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 280us (857us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384396.079113:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:1.0:1787384396.081974:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173862400 00000100:00100000:1.0:1787384396.081991:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173862400 00000100:00100000:1.0:1787384396.082056:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:1.0:1787384396.082065:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:8098:x1874208173862400:12345-192.168.203.51@tcp:33:mount.lustre.0 00000004:00200000:1.0:1787384396.082316:0:5786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1787384396.082450:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:8098:x1874208173862400:12345-192.168.203.51@tcp:33:mount.lustre.0 Request processed in 385us (4277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384396.082458:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00010000:00010000:0.0:1787384396.811422:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384397.843566:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384398.409079:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384398.411446:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195915008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384398.411527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384398.411676:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195915008 00000100:00100000:3.0:1787384398.411684:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195915008 00000100:00100000:3.0:1787384398.411747:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1787384398.411757:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195915008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384398.411891:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384398.411948:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195915008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 192us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384398.411956:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1787384398.413509:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384398.413560:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eedf80 x1874208195915008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384414 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384398.413585:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eedf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195915008:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384398.859376:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384398.921714:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195915520:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.921782:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.921834:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787384398.921841:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195915136:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.921895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.921939:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195915648:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.922023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.922052:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195915264:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.922076:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.922090:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195915776:0@lo:400:kworker.0 00000100:00100000:2.0:1787384398.922468:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195915520 00000100:00100000:2.0:1787384398.922475:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195915520 00000100:00100000:2.0:1787384398.922517:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384398.922525:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195915520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384398.922574:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbdb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195915520:12345-0@lo:400:kworker.0 Request processed in 49us (791us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384398.922580:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384398.922599:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195915648 00000100:00100000:2.0:1787384398.922602:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195915648 00000100:00100000:2.0:1787384398.922639:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195915264 00000100:00100000:2.0:1787384398.922642:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195915264 00000100:00100000:2.0:1787384398.922655:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787384398.922660:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195915648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384398.922695:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195915648:12345-0@lo:400:kworker.0 Request processed in 34us (671us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384398.922701:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787384398.922710:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787384398.922715:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195915264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384398.922750:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbdad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195915264:12345-0@lo:400:kworker.0 Request processed in 35us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384398.922756:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787384398.922789:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195915648:0@lo:400:kworker.0 00010000:00080000:2.0:1787384398.922802:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37bbdb480 x1874208195915520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384398.922812:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195915520:0@lo:400:kworker.0 00000100:00080000:2.0:1787384398.922832:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384398.923017:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.923052:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195915264:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.923061:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384398.923068:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195915392:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.923090:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384398.923116:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195915392 00000100:00100000:0.0:1787384398.923120:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195915392 00000100:00100000:0.0:1787384398.923147:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787384398.923153:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195915392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.923188:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195915392:12345-0@lo:400:kworker.0 Request processed in 35us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384398.923194:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787384398.923293:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbdbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195915392:0@lo:400:kworker.0 00000100:00100000:2.0:1787384398.923421:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195915776 00000100:00100000:2.0:1787384398.923426:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195915776 00000100:00100000:2.0:1787384398.923472:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787384398.923479:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195915776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384398.923517:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195915776:12345-0@lo:400:kworker.0 Request processed in 39us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384398.923523:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787384398.923540:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384398.923544:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787384398.923560:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37bbd9f80 x1874208195915776/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384414 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384398.923571:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195915776:0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.926339:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195915136 00000100:00100000:0.0:1787384398.926351:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195915136 00000100:00100000:0.0:1787384398.926405:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1787384398.926413:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195915136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384398.926500:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195915136:12345-0@lo:400:kworker.0 Request processed in 87us (4603us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384398.926507:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1787384398.926659:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195915136:0@lo:400:kworker.0 00000100:00100000:0.0:1787384399.433167:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195915904:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384399.433292:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384399.433521:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195915904 00000100:00100000:2.0:1787384399.433529:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195915904 00000100:00100000:2.0:1787384399.433595:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787384399.433605:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195915904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384399.433646:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384399.433713:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195915904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384399.433720:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:0.0:1787384399.433958:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eef100 x1874208195915904/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384415 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384399.433976:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195915904:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787384399.881571:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787384399.992811:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5b85b8ac-6b36-499b-99d6-8bdc07d5605c 00000001:00100000:0.0:1787384400.071656:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5b85b8ac-6b36-499b-99d6-8bdc07d5605c 00000001:00100000:1.0:1787384400.492856:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b85b8ac-6b36-499b-99d6-8bdc07d5605c 00010000:00010000:0.0:1787384400.905818:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384401.566786:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384401.566836:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384401.566928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384401.566949:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384401.566973:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384401.567082:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173862912 00000100:00100000:0.0:1787384401.567092:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173862912 00000100:00100000:1.0:1787384401.567129:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173862528 00000100:00100000:1.0:1787384401.567136:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173862528 00000100:00100000:0.0:1787384401.567157:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173863040 00000100:00100000:0.0:1787384401.567162:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173863040 00000100:00100000:1.0:1787384401.567179:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 222 00000100:00100000:1.0:1787384401.567192:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173862528:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384401.567195:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:0.0:1787384401.567209:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173862912:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384401.567287:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173862656 00000100:00100000:2.0:1787384401.567291:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173862656 00000100:00100000:0.0:1787384401.567333:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173862912:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 127us (495us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384401.567341:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:0.0:1787384401.567357:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:0.0:1787384401.567365:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173863040:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384401.567383:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173862528:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 193us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384401.567395:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173863040:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 28us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384401.567402:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 222 00000100:00100000:0.0:1787384401.567408:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00080000:3.0:1787384401.568064:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384401.568071:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787384401.568073:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384401.568688:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173862784 00000100:00100000:2.0:1787384401.568695:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173862784 00000100:00080000:0.0:1787384401.569588:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384401.575165:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:1.0:1787384401.575195:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173862656:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384401.575288:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173862656:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 111us (8513us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384401.575296:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:1.0:1787384401.576279:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:1.0:1787384401.576297:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173862784:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384401.577066:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eeb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173862784:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 773us (10112us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384401.577074:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 70 00010000:00010000:0.0:1787384401.928986:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787384402.814445:0:10160:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:3.0:1787384402.960185:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384403.529307:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195916032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384403.529406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384403.529572:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195916032 00000100:00100000:1.0:1787384403.529585:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195916032 00000100:00100000:1.0:1787384403.529671:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787384403.529688:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195916032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384403.529733:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384403.529799:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195916032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384403.529806:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1787384403.529854:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37275ea00 x1874208195916032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384419 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787384403.529892:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384403.529923:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195916032:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787384403.977639:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384404.041915:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195916544:0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.042018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384404.042099:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787384404.042105:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195916160:0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.042135:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384404.042169:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195916672:0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.042194:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384404.042225:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195916416:0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.042268:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384404.042293:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1787384404.042299:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195916288:0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.042321:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384404.042335:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195916800:0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.042353:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384404.042382:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195916544 00000100:00100000:0.0:1787384404.042390:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195916544 00000100:00100000:0.0:1787384404.042449:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195916800 00000100:00100000:0.0:1787384404.042452:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195916800 00000100:00100000:0.0:1787384404.042476:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787384404.042484:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195916544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.042538:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195916544:12345-0@lo:400:kworker.0 Request processed in 54us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384404.042545:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787384404.042562:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787384404.042568:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195916800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.043614:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195916800:12345-0@lo:400:kworker.0 Request processed in 1037us (1251us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384404.043637:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787384404.043680:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195916160 00000100:00100000:0.0:1787384404.043688:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195916160 00000100:00100000:0.0:1787384404.043729:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787384404.043738:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195916160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.043955:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195916160:12345-0@lo:400:kworker.0 Request processed in 217us (1818us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384404.043962:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1787384404.043998:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195916672 00000100:00100000:0.0:1787384404.044003:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195916672 00000100:00100000:0.0:1787384404.044049:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195916416 00000100:00100000:0.0:1787384404.044052:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195916416 00000100:00100000:0.0:1787384404.044066:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195916288 00000100:00100000:0.0:1787384404.044068:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195916288 00000100:00100000:0.0:1787384404.044082:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787384404.044087:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195916672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.044122:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195916672:12345-0@lo:400:kworker.0 Request processed in 35us (1927us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384404.044128:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787384404.044139:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787384404.044638:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195916416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.044689:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195916416:12345-0@lo:400:kworker.0 Request processed in 542us (2419us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384404.044695:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787384404.044712:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787384404.044719:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195916288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.044762:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195916288:12345-0@lo:400:kworker.0 Request processed in 44us (2439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384404.044955:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:0.0:1787384404.044999:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384404.045005:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384404.045492:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195916288:0@lo:400:kworker.0 00010000:00080000:0.0:1787384404.045514:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37bbdb800 x1874208195916800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384404.045526:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195916800:0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.045539:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195916416:0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.045661:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195916160:0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.045679:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195916672:0@lo:400:kworker.0 00010000:00080000:0.0:1787384404.045693:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37bbd8a80 x1874208195916544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384420 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384404.045703:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195916544:0@lo:400:kworker.0 00000100:00100000:0.0:1787384404.553085:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195916928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384404.553156:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384404.553684:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195916928 00000100:00100000:1.0:1787384404.553691:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195916928 00000100:00100000:1.0:1787384404.553745:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787384404.553754:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195916928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384404.553785:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384404.553967:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195916928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 213us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384404.553973:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787384404.554084:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eeed80 x1874208195916928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384420 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384404.554103:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195916928:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787384405.001182:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384406.025009:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384406.690528:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384406.690585:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384406.690620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384406.690648:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384406.690696:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173863680 00000100:00100000:3.0:1787384406.690709:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173863680 00000100:00100000:3.0:1787384406.690792:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:3.0:1787384406.690805:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173863680:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384406.690954:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eea300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173863680:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 153us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384406.690965:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:3.0:1787384406.690997:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173863424 00000100:00100000:3.0:1787384406.691001:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173863424 00000100:00100000:3.0:1787384406.691031:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173863296 00000100:00100000:3.0:1787384406.691034:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173863296 00000100:00100000:3.0:1787384406.691058:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:3.0:1787384406.691065:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173863424:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384406.691097:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173863424:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 33us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384406.691104:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:3.0:1787384406.691116:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 75 00000100:00100000:3.0:1787384406.691122:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173863296:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384406.691146:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eea680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173863296:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384406.691165:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 75 00000100:00080000:3.0:1787384406.691182:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384406.691187:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384406.691390:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173863168 00000100:00100000:1.0:1787384406.691396:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173863168 00000100:00100000:1.0:1787384406.691443:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 224 00000100:00100000:1.0:1787384406.691451:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173863168:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384406.691488:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173863168:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 38us (976us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384406.691494:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 224 00000100:00100000:3.0:1787384406.693598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384406.695371:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173863552 00000100:00100000:1.0:1787384406.695401:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173863552 00000100:00100000:1.0:1787384406.695527:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:1.0:1787384406.695544:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173863552:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384406.695652:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173863552:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 115us (2065us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384406.695660:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00080000:0.0:1787384406.698762:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787384407.049280:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384408.073107:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384408.649142:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195917056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384408.649215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384408.649284:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195917056 00000100:00100000:2.0:1787384408.649294:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195917056 00000100:00100000:2.0:1787384408.649380:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787384408.649390:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195917056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384408.649438:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787384408.649658:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384408.652377:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195917056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2979us (3152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384408.652392:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:0.0:1787384408.654161:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37275ea00 x1874208195917056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384424 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384408.654187:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195917056:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384409.100454:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384409.162233:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384409.163710:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195917312:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.163816:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384409.163926:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384409.163934:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195917440:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.163960:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384409.164006:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195917312 00000100:00100000:2.0:1787384409.164017:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195917312 00000100:00100000:2.0:1787384409.164076:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195917440 00000100:00100000:2.0:1787384409.164079:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195917440 00000100:00100000:2.0:1787384409.164121:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787384409.164131:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195917312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.164191:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195917312:12345-0@lo:400:kworker.0 Request processed in 61us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384409.164199:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787384409.164219:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787384409.164225:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195917440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.164253:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195917440:12345-0@lo:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384409.164259:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:2.0:1787384409.164285:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384409.164327:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195917440:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.164338:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195917312:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.166149:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195917568:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.166235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384409.166301:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195917184:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.166333:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384409.166404:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195917184 00000100:00100000:0.0:1787384409.166412:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195917184 00000100:00100000:0.0:1787384409.166455:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787384409.166461:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195917184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.166502:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195917184:12345-0@lo:400:kworker.0 Request processed in 42us (170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384409.166507:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1787384409.166848:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195917184:0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.166978:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195917568 00000100:00100000:2.0:1787384409.166983:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195917568 00000100:00100000:2.0:1787384409.167030:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384409.167038:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195917568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.167085:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195917568:12345-0@lo:400:kworker.0 Request processed in 48us (850us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384409.167092:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787384409.168299:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e372cd7480 x1874208195917568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384409.168319:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195917568:0@lo:400:kworker.0 00000100:00100000:3.0:1787384409.171949:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195917824:0@lo:400:kworker.0 00000100:00100000:1.0:1787384409.172006:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195917696:0@lo:400:kworker.0 00000100:00100000:3.0:1787384409.172049:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384409.172713:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384409.173405:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195917824 00000100:00100000:2.0:1787384409.173419:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195917824 00000100:00100000:2.0:1787384409.173525:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787384409.173538:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195917824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384409.173675:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195917824:12345-0@lo:400:kworker.0 Request processed in 135us (1624us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384409.173684:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1787384409.173715:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787384409.175590:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e372cd5f80 x1874208195917824/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384409.175614:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195917824:0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.180448:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195917696 00000100:00100000:0.0:1787384409.180464:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195917696 00000100:00100000:0.0:1787384409.180570:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384409.180582:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195917696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384409.180701:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195917696:12345-0@lo:400:kworker.0 Request processed in 122us (7991us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384409.180709:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1787384409.180785:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195917696:0@lo:400:kworker.0 00000100:00080000:3.0:1787384409.181069:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384409.674891:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195917952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384409.674967:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384409.675101:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195917952 00000100:00100000:2.0:1787384409.675110:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195917952 00000100:00100000:2.0:1787384409.675156:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384409.675166:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195917952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384409.675200:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384409.675254:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195917952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384409.675262:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1787384409.675555:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eece00 x1874208195917952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384425 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384409.675574:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195917952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787384410.122940:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384411.146965:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384411.806998:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384411.807052:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384411.807076:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173863936 00000100:00100000:3.0:1787384411.807085:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173863936 00000100:00100000:1.0:1787384411.807090:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384411.807132:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384411.807145:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173864064 00000100:00100000:3.0:1787384411.807149:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173864064 00000100:00100000:3.0:1787384411.807176:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:3.0:1787384411.807186:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173863936:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384411.807232:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384411.807261:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173863936:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 76us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384411.807268:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:3.0:1787384411.807288:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:3.0:1787384411.807295:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173864064:12345-192.168.203.51@tcp:400:kworker.0 00000100:00080000:2.0:1787384411.810681:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384411.810707:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173863808 00000100:00100000:2.0:1787384411.810717:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173863808 00000100:00100000:2.0:1787384411.810943:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 226 00000100:00100000:2.0:1787384411.810952:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173863808:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384411.815424:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173864192 00000100:00100000:1.0:1787384411.815440:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173864192 00000100:00100000:1.0:1787384411.815529:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173864320 00000100:00100000:1.0:1787384411.815534:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173864320 00000100:00100000:1.0:1787384411.815563:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:1.0:1787384411.815574:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173864192:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384411.816026:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173864192:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 452us (8972us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384411.816034:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:1.0:1787384411.816052:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:1.0:1787384411.816061:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173864320:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384411.816090:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173864320:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 31us (8859us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384411.816096:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00080000:1.0:1787384411.816131:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384411.816136:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384411.818791:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173864064:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 11485us (11648us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384411.818826:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:2.0:1787384411.828940:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173863808:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 17977us (21838us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384411.828956:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 226 00010000:00010000:2.0:1787384412.169529:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384413.194883:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384413.772833:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384413.772855:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195918080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384413.772944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384413.773160:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195918080 00000100:00100000:1.0:1787384413.773168:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195918080 00000100:00100000:1.0:1787384413.773230:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384413.773244:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195918080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384413.773278:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384413.773340:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195918080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384413.773347:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787384413.773374:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787384413.774395:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e372cd2a00 x1874208195918080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384429 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384413.774417:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195918080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787384414.217198:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384414.281232:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195918208:0@lo:400:kworker.0 00000100:00100000:2.0:1787384414.281305:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384414.281410:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195918208 00000100:00100000:0.0:1787384414.281420:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195918208 00000100:00100000:3.0:1787384414.281471:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195918592:0@lo:400:kworker.0 00000100:00100000:0.0:1787384414.281547:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1787384414.281560:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195918208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.281578:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.281635:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195918336:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.281665:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.281684:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384414.281690:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195918464:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.281712:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384414.281741:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195918592 00000100:00100000:3.0:1787384414.281745:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195918592 00000100:00100000:3.0:1787384414.281775:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384414.281782:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195918592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.281830:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742d2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195918592:12345-0@lo:400:kworker.0 Request processed in 48us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.281849:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384414.283505:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195918336 00000100:00100000:3.0:1787384414.283515:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195918336 00000100:00100000:3.0:1787384414.284388:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195918464 00000100:00100000:3.0:1787384414.284393:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195918464 00000100:00100000:3.0:1787384414.284435:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787384414.284445:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195918336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.284523:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195918336:12345-0@lo:400:kworker.0 Request processed in 80us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.284544:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787384414.284562:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787384414.284568:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195918464:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787384414.285381:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384414.285443:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384414.285465:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195918848:0@lo:400:kworker.0 00010000:00080000:2.0:1787384414.286893:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e372cd3480 x1874208195918592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384414.286909:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195918592:0@lo:400:kworker.0 00000100:00100000:2.0:1787384414.286942:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384414.286951:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195918720:0@lo:400:kworker.0 00000100:00100000:1.0:1787384414.289744:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384414.289744:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195918208:12345-0@lo:400:kworker.0 Request processed in 8182us (8434us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384414.289767:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787384414.289804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384414.289828:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195918848 00000100:00100000:1.0:1787384414.289836:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195918848 00000100:00100000:2.0:1787384414.289844:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195918720 00000100:00100000:2.0:1787384414.289850:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195918720 00000100:00100000:2.0:1787384414.289910:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787384414.289918:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195918720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384414.290017:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195918720:12345-0@lo:400:kworker.0 Request processed in 100us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384414.290024:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787384414.290062:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195918720:0@lo:400:kworker.0 00000100:00100000:0.0:1787384414.290133:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195918208:0@lo:400:kworker.0 00000100:00100000:2.0:1787384414.290143:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195918464:0@lo:400:kworker.0 00000100:00100000:2.0:1787384414.290173:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195918336:0@lo:400:kworker.0 00000100:00080000:0.0:1787384414.290197:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384414.290204:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384414.290221:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787384414.290225:0:6575:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787384414.290234:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195918848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384414.290235:0:6575:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:1.0:1787384414.290284:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195918848:12345-0@lo:400:kworker.0 Request processed in 56us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384414.290291:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1787384414.290359:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e372cd1f80 x1874208195918848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384414.290370:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195918848:0@lo:400:kworker.0 00000100:00100000:3.0:1787384414.297252:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195918464:12345-0@lo:400:kworker.0 Request processed in 12674us (15530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384414.297267:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1787384414.793210:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195918976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384414.793288:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384414.793553:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195918976 00000100:00100000:2.0:1787384414.793562:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195918976 00000100:00100000:2.0:1787384414.793619:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787384414.793629:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195918976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384414.793661:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384414.793706:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195918976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384414.793713:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1787384414.793823:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eec700 x1874208195918976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384430 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384414.793842:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195918976:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787384415.241169:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384416.267535:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384416.933439:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384416.933524:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384416.933557:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384416.933613:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384416.933656:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173864704 00000100:00100000:0.0:1787384416.933666:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173864704 00000100:00100000:0.0:1787384416.933721:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173864576 00000100:00100000:0.0:1787384416.933725:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173864576 00000100:00100000:0.0:1787384416.933750:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:0.0:1787384416.933758:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173864704:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384416.933838:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173864704:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 80us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384416.934227:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173864448 00000100:00100000:3.0:1787384416.934232:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173864448 00000100:00100000:3.0:1787384416.934261:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 228 00000100:00100000:3.0:1787384416.934268:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173864448:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384416.934301:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173864448:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 34us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384416.934319:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 228 00000100:00100000:0.0:1787384416.934505:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:1.0:1787384416.938096:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 85 00000100:00100000:1.0:1787384416.938127:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173864576:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384416.938208:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173864576:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 99us (4594us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384416.938216:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 85 00000100:00080000:1.0:1787384416.938275:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384416.938559:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173864832 00000100:00100000:2.0:1787384416.938568:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173864832 00000100:00100000:2.0:1787384416.938632:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1787384416.938640:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2349:x1874208173864832:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:2.0:1787384416.938659:0:6574:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3428 00000100:00080000:2.0:1787384416.938667:0:6574:0:(import.c:65:import_set_state_nolock()) ffff89e3441a0800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787384416.938702:0:6574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1787384416.939049:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+2:2349:x1874208173864832:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 409us (5620us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384416.939056:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00010000:00010000:2.0:1787384416.939075:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787384416.946769:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384416.960264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384416.960345:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173864960 00000100:00100000:3.0:1787384416.960357:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173864960 00000100:00100000:3.0:1787384416.960426:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:3.0:1787384416.960437:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2349:x1874208173864960:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:3.0:1787384416.960467:0:6575:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c342f 00000100:00080000:3.0:1787384416.960475:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89e3441a2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787384416.960521:0:6575:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787384416.960907:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+2:2349:x1874208173864960:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 471us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384416.960916:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00010000:00010000:0.0:1787384416.961006:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787384416.961243:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787384417.290796:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384418.313085:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384418.896845:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384418.896888:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195919104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384418.896959:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384418.897157:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195919104 00000100:00100000:3.0:1787384418.897165:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195919104 00000100:00100000:3.0:1787384418.897238:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787384418.897250:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195919104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384418.897297:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384418.897359:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195919104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384418.897366:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:2.0:1787384418.897472:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e372cd0000 x1874208195919104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384434 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384418.897502:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195919104:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787384418.897621:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787384419.337037:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384419.401138:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384419.401159:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195919360:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.401223:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384419.401307:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195919488:0@lo:400:kworker.0 00000100:00100000:3.0:1787384419.401330:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384419.401490:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195919616:0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.401519:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384419.401547:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787384419.401553:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195919232:0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.401579:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384419.401600:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195919744:0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.401623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384419.401650:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195919232 00000100:00100000:0.0:1787384419.401657:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195919232 00000100:00100000:0.0:1787384419.401715:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787384419.401725:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195919232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.401783:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195919232:12345-0@lo:400:kworker.0 Request processed in 60us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384419.401790:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787384419.401853:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195919232:0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.402004:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195919360 00000100:00100000:1.0:1787384419.402008:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195919360 00000100:00100000:1.0:1787384419.402041:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195919488 00000100:00100000:1.0:1787384419.402044:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195919488 00000100:00100000:1.0:1787384419.402061:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195919616 00000100:00100000:1.0:1787384419.402068:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195919616 00000100:00100000:1.0:1787384419.402084:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787384419.402089:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195919360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.402137:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195919360:12345-0@lo:400:kworker.0 Request processed in 47us (914us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384419.402143:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1787384419.402154:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787384419.402160:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195919488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.402181:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195919488:12345-0@lo:400:kworker.0 Request processed in 22us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384419.402186:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787384419.402196:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787384419.402202:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195919616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.402230:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195919616:12345-0@lo:400:kworker.0 Request processed in 28us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384419.402235:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1787384419.402254:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384419.402274:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195919488:0@lo:400:kworker.0 00000100:00100000:1.0:1787384419.402283:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195919360:0@lo:400:kworker.0 00000100:00100000:2.0:1787384419.402563:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195919744 00000100:00100000:2.0:1787384419.402569:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195919744 00000100:00100000:2.0:1787384419.402620:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384419.402629:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195919744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384419.402667:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195919744:12345-0@lo:400:kworker.0 Request processed in 39us (1042us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384419.402672:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1787384419.402916:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e372cd6300 x1874208195919744/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384435 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384419.402928:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195919744:0@lo:400:kworker.0 00000100:00100000:0.0:1787384419.402939:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195919616:0@lo:400:kworker.0 00000100:00080000:1.0:1787384419.403671:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384419.920089:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384419.920112:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195919872:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384419.920175:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384419.920578:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195919872 00000100:00100000:2.0:1787384419.920586:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195919872 00000100:00100000:2.0:1787384419.920640:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787384419.920649:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195919872:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384419.920681:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384419.920744:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195919872:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384419.920751:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1787384419.920979:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eee680 x1874208195919872/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384435 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384419.920999:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195919872:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787384420.372174:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787384420.501313:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5b85b8ac-6b36-499b-99d6-8bdc07d5605c 00000020:00000080:0.0:1787384420.501324:0:7483:0:(genops.c:906:class_export_put()) final put ffff89e3441a5000/5b85b8ac-6b36-499b-99d6-8bdc07d5605c 00000020:00000080:0.0:1787384420.501351:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3441a5000/5b85b8ac-6b36-499b-99d6-8bdc07d5605c for lustre-OST0001 00000020:00000080:0.0:1787384420.501389:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e3441a2000 for lustre-OST0001 00000001:02000400:0.0:1787384420.790817:0:10863:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1787384421.023484:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5b85b8ac-6b36-499b-99d6-8bdc07d5605c 00000020:00000080:1.0:1787384421.023492:0:6600:0:(genops.c:906:class_export_put()) final put ffff89e3441a1800/5b85b8ac-6b36-499b-99d6-8bdc07d5605c 00000020:00000080:1.0:1787384421.023531:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3441a1800/5b85b8ac-6b36-499b-99d6-8bdc07d5605c for lustre-OST0000 00000020:00000080:1.0:1787384421.023570:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e3441a0800 for lustre-OST0000 00010000:00010000:1.0:1787384421.385099:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384422.055542:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384422.055883:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384422.055923:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384422.062053:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173865344 00000100:00100000:1.0:1787384422.062076:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173865344 00000100:00100000:1.0:1787384422.062476:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173865216 00000100:00100000:1.0:1787384422.062482:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173865216 00000100:00100000:3.0:1787384422.062552:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173865088 00000100:00100000:3.0:1787384422.062557:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173865088 00000100:00100000:3.0:1787384422.062582:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:3.0:1787384422.062597:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173865344:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384422.062706:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173865344:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 114us (6823us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384422.062715:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:3.0:1787384422.062933:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 230 00000100:00100000:3.0:1787384422.062959:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173865088:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384422.062995:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173865088:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 37us (7469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384422.063002:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 230 00000100:00080000:2.0:1787384422.064042:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384422.066209:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00100000:1.0:1787384422.066228:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173865216:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384422.066336:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173865216:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 114us (10412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384422.066344:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 90 00010000:00010000:0.0:1787384422.409066:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384423.434105:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384424.011528:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195920000:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384424.011599:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384424.013013:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195920000 00000100:00100000:2.0:1787384424.013024:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195920000 00000100:00100000:2.0:1787384424.013101:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787384424.013111:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195920000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384424.013148:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787384424.013182:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384424.013436:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195920000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 325us (1835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384424.013444:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:0.0:1787384424.013747:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e377b4f800 x1874208195920000/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384440 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384424.013767:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195920000:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787384424.457985:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787384424.517530:0:11013:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffc5531bb80 00000020:00000080:1.0:1787384424.517546:0:11013:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787384424.517551:0:11013:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787384424.517559:0:11013:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5531de10 20000000:00000080:1.0:1787384424.517566:0:11013:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e37b8e5800 uarg=0000000000000000 20000000:01000000:1.0:1787384424.517604:0:11013:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787384424.517610:0:11013:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787384424.517615:0:11013:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000100:00100000:3.0:1787384424.521669:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195920256:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.521723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.521822:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787384424.521829:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195920128:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.521882:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.521908:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195920640:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.521932:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384424.521959:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195920128 00000100:00100000:3.0:1787384424.521966:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195920128 00000100:00100000:3.0:1787384424.522003:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000040:00080000:1.0:1787384424.522010:0:11014:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 00000100:00100000:3.0:1787384424.522011:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195920128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.522056:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195920128:12345-0@lo:400:kworker.0 Request processed in 45us (198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.522063:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 20000000:00000400:1.0:1787384424.522063:0:11013:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 00000100:00100000:3.0:1787384424.522093:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195920640 00000100:00100000:3.0:1787384424.522096:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195920640 00000100:00100000:3.0:1787384424.522127:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787384424.522133:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195920640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.522230:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195920640:12345-0@lo:400:kworker.0 Request processed in 95us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.522237:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:3.0:1787384424.522263:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384424.522267:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195920384:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.522290:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eeea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195920128:0@lo:400:kworker.0 00000100:00100000:0.0:1787384424.522297:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1787384424.522304:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eee680 x1874208195920640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384440 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384424.522314:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eee680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195920640:0@lo:400:kworker.0 00000100:00100000:2.0:1787384424.523596:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195920256 00000100:00100000:0.0:1787384424.523599:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384424.523606:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195920256 00000100:00100000:0.0:1787384424.523609:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195920512:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.523648:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195920384 00000100:00100000:3.0:1787384424.523652:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195920384 00000100:00100000:0.0:1787384424.523659:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384424.523689:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195920512 00000100:00100000:2.0:1787384424.523693:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195920512 00000100:00100000:3.0:1787384424.523814:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787384424.523823:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195920384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.523900:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195920384:12345-0@lo:400:kworker.0 Request processed in 78us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.523907:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1787384424.523941:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787384424.523947:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195920256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.523982:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195920256:12345-0@lo:400:kworker.0 Request processed in 35us (2257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.523988:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1787384424.524021:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195920256:0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.524389:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1787384424.524397:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195920512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384424.524432:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195920512:12345-0@lo:400:kworker.0 Request processed in 37us (772us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384424.524438:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:0.0:1787384424.527001:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384424.527057:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195920512:0@lo:400:kworker.0 00000100:00100000:0.0:1787384424.527073:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195920384:0@lo:400:kworker.0 10000000:01000000:1.0:1787384424.531715:0:11013:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787384424.531754:0:11013:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.531777:0:11013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c33db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c48 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.531786:0:11013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c33e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c33e2 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.531810:0:11013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e340031400/0x3522fbed3b6c33f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c33f0 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.532147:0:11013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e340030200/0x3522fbed3b6c3405 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c33fe expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.533369:0:11013:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e36624ca00/0x3522fbed3b6c341a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c80 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.533381:0:11013:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.533427:0:11013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e36624ca00/0x3522fbed3b6c341a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c80 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.533443:0:11013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e36624ca00/0x3522fbed3b6c341a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c80 expref: 12 pid: 5777 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384424.533458:0:11013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1874208195920768:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384424.533612:0:11013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e340030200/0x3522fbed3b6c3405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c33fe expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.533620:0:11013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e340030200/0x3522fbed3b6c3405 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c33fe expref: 18 pid: 5777 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384424.533630:0:11013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1874208195920896:0@lo:104: 00000100:00100000:1.0:1787384424.533667:0:11013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384424.533704:0:11013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e340031400/0x3522fbed3b6c33f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c33f0 expref: 18 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.533722:0:11013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e340031400/0x3522fbed3b6c33f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c33f0 expref: 18 pid: 5776 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384424.533741:0:11013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1874208195921024:0@lo:104: 00000100:00100000:1.0:1787384424.533762:0:11013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384424.533784:0:11013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c33e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c33e2 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.533792:0:11013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c33e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c33e2 expref: 18 pid: 5778 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384424.533799:0:11013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1874208195921152:0@lo:104: 00000100:00100000:1.0:1787384424.533909:0:11013:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384424.533932:0:11013:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c33db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c48 expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.533940:0:11013:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c33db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c48 expref: 12 pid: 5778 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384424.533949:0:11013:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1874208195921280:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384424.533968:0:11013:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3779cd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384424.535118:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195920896 00000100:00100000:1.0:1787384424.535129:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195920896 00000100:00100000:1.0:1787384424.535183:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195921024 00000100:00100000:1.0:1787384424.535187:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195921024 00000100:00100000:1.0:1787384424.535199:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195921152 00000100:00100000:1.0:1787384424.535201:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195921152 00000100:00100000:1.0:1787384424.535215:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384424.535223:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+5:11013:x1874208195920896:12345-0@lo:104: 00010000:00010000:1.0:1787384424.535402:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535469:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384424.535475:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+5:11013:x1874208195920896:12345-0@lo:104: Request processed in 253us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384424.535481:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384424.535499:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787384424.535506:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+4:11013:x1874208195921024:12345-0@lo:104: 00010000:00010000:1.0:1787384424.535512:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535545:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787384424.535550:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+4:11013:x1874208195921024:12345-0@lo:104: Request processed in 46us (1788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384424.535556:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787384424.535566:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384424.535572:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:11013:x1874208195921152:12345-0@lo:104: 00010000:00010000:1.0:1787384424.535579:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535606:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1787384424.535611:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:11013:x1874208195921152:12345-0@lo:104: Request processed in 40us (1702us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384424.535616:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:1.0:1787384424.535631:0:8293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787384424.535635:0:8293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535648:0:8293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030000 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:1.0:1787384424.535652:0:8293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535660:0:8293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384424.535667:0:8293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384424.535673:0:8293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787384424.535705:0:8293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535711:0:8293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384424.535741:0:8293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535748:0:8293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c33fe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3405 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535765:0:8293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384424.535768:0:8293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535774:0:8293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:1.0:1787384424.535777:0:8293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535794:0:8293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384424.535800:0:8293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384424.535805:0:8293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384424.535812:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384424.535818:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384424.535825:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624da00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384424.535828:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384424.535834:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384424.535840:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384424.535870:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384424.535887:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384424.535893:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384424.535907:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535908:0:8293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535914:0:8293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384424.535914:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e36624da00/0x3522fbed3b6c33e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c33e9 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535920:0:8293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.535926:0:8293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c33f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c33f7 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384424.535934:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384424.535936:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384424.535938:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384424.535938:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384424.535940:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384424.535941:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384424.535951:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384424.535963:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195921408:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384424.535968:0:11013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1874208195920896:0@lo:104: 00000100:00100000:1.0:1787384424.535987:0:11013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1874208195921024:0@lo:104: 00000100:00100000:1.0:1787384424.535996:0:11013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd2680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1874208195921152:0@lo:104: 00000100:00100000:0.0:1787384424.535998:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384424.536033:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195921664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384424.536058:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384424.536083:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384424.536088:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195921536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384424.536106:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384424.536128:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195921408 00000100:00100000:0.0:1787384424.536132:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195921408 00000100:00100000:1.0:1787384424.536140:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195921664 00000100:00100000:1.0:1787384424.536143:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195921664 00010000:00010000:0.0:1787384424.536152:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e340030200/0x3522fbed3b6c3405 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c33fe expref: 20 pid: 5777 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.536166:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e340031400/0x3522fbed3b6c33f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c33f0 expref: 20 pid: 5776 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384424.536185:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195921536 00000100:00100000:1.0:1787384424.536193:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195921536 00010000:00010000:1.0:1787384424.536207:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c33e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c33e2 expref: 21 pid: 5778 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384424.536221:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384424.536409:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349e11850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+21:3304:x1874208195921408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384424.536421:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384424.536426:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e340030200/0x3522fbed3b6c3405 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c33fe expref: 21 pid: 5777 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.536435:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e340030200/0x3522fbed3b6c3405 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c33fe expref: 21 pid: 5777 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.536450:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340030200/0x3522fbed3b6c3405 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c33fe expref: 21 pid: 5777 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.536463:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384424.536496:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349e11850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+20:3304:x1874208195921408:12345-0@lo:103:ldlm_bl.0 Request processed in 269us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384424.536502:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384424.536538:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384424.536545:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3307:x1874208195921664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384424.536551:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384424.536556:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e340031400/0x3522fbed3b6c33f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c33f0 expref: 19 pid: 5776 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.536564:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e340031400/0x3522fbed3b6c33f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c33f0 expref: 19 pid: 5776 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384424.536574:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340031400/0x3522fbed3b6c33f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c33f0 expref: 19 pid: 5776 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384424.536578:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384424.536585:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3307:x1874208195921536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384424.536588:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384424.536593:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384424.536598:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c33e9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c33e2 expref: 18 pid: 5778 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384424.536607:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c33e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c33e2 expref: 18 pid: 5778 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384424.536614:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3307:x1874208195921664:12345-0@lo:103:ldlm_bl.0 Request processed in 70us (555us total) trans 0 rc 0/0 00010000:00010000:0.0:1787384424.536617:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c33e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c33e2 expref: 18 pid: 5778 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384424.536619:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787384424.536636:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384424.536659:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3307:x1874208195921536:12345-0@lo:103:ldlm_bl.0 Request processed in 74us (552us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384424.536741:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384424.536776:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195921408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384424.536798:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195921536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384424.536805:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195921664:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384424.537112:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384424.545657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384424.545721:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384424.545746:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173865472 00000100:00100000:0.0:1787384424.545756:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173865472 00010000:00010000:0.0:1787384424.545793:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e36624ca00/0x3522fbed3b6c341a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c80 expref: 13 pid: 5777 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384424.545827:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173865600 00000100:00100000:0.0:1787384424.545831:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173865600 00010000:00010000:0.0:1787384424.545843:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c33db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c48 expref: 14 pid: 5778 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384424.545891:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:0.0:1787384424.545901:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+14:2352:x1874208173865472:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384424.545914:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384424.545921:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e36624ca00/0x3522fbed3b6c341a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c80 expref: 14 pid: 5777 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384424.545934:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e36624ca00/0x3522fbed3b6c341a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c80 expref: 14 pid: 5777 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384424.545967:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384424.545991:0:11013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624ca00/0x3522fbed3b6c341a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c80 expref: 14 pid: 5777 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384424.546008:0:11013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1874208195920768:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384424.546037:0:11013:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd1f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11013:1874208195921280:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384424.546073:0:11013:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384424.546153:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173865472:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 252us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384424.546544:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:2.0:1787384424.546556:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96efe439-3b25-4671-a225-6795623d17b0+13:2350:x1874208173865600:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384424.546567:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384424.546574:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c33db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c48 expref: 13 pid: 5778 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.546585:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c33db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c48 expref: 13 pid: 5778 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.546597:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c33db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c48 expref: 13 pid: 5778 timeout: 385 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.546609:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.546617:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.546632:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.546639:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.546657:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.548041:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.548049:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384424.548054:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.548062:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.548089:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384424.548104:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384424.549760:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96efe439-3b25-4671-a225-6795623d17b0+12:2350:x1874208173865600:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 1605us (2437us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384424.549775:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00010000:00010000:3.0:1787384424.549828:0:11013:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384424.549839:0:11013:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384424.552531:0:11013:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624d800/0x3522fbed3b6c3436 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11013 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384424.554112:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:3.0:1787384425.033183:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384425.033206:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195921792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384425.033273:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384425.033702:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195921792 00000100:00100000:1.0:1787384425.033710:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195921792 00000100:00100000:1.0:1787384425.033777:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787384425.033786:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195921792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384425.033820:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384425.033895:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195921792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 109us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384425.033903:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:3.0:1787384425.034092:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eec700 x1874208195921792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384441 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384425.034110:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195921792:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787384425.482320:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384426.017107:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384426.017205:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173865728 00000100:00100000:0.0:1787384426.017215:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173865728 00000100:00100000:0.0:1787384426.017273:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 232 00000100:00100000:0.0:1787384426.017283:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+11:5568:x1874208173865728:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384426.017301:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384426.017322:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c343d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78caa expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384426.017348:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c343d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78caa expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384426.017359:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c343d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78caa expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384426.017368:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a000, rc 0) 00000100:00100000:0.0:1787384426.017422:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173865728:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 140us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384426.017442:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 232 00000100:00100000:3.0:1787384426.028160:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384426.028233:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173865856 00000100:00100000:1.0:1787384426.028243:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173865856 00000100:00100000:1.0:1787384426.028301:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 233 00000100:00100000:1.0:1787384426.028311:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173865856:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384426.028889:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173865856:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 549us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384426.028905:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 233 00000100:00100000:0.0:1787384426.042064:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384426.042211:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173865984 00000100:00100000:1.0:1787384426.042221:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173865984 00000100:00100000:1.0:1787384426.042275:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 234 00000100:00100000:1.0:1787384426.042286:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173865984:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384426.042520:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173865984:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 236us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384426.042529:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 234 00000100:00100000:3.0:1787384426.048383:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384426.048647:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173866112 00000100:00100000:1.0:1787384426.048661:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173866112 00000100:00100000:1.0:1787384426.048743:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 235 00000100:00100000:1.0:1787384426.048756:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173866112:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384426.048787:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384426.048813:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c3444 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78cb1 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384426.048848:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c3444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb1 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384426.048913:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c3444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb1 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384426.048925:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d600, rc 0) 00000100:00100000:1.0:1787384426.049014:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:5568:x1874208173866112:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 260us (646us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384426.049021:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 235 00000100:00100000:0.0:1787384426.063027:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384426.066602:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173866240 00000100:00100000:3.0:1787384426.066618:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173866240 00000100:00100000:3.0:1787384426.066690:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 236 00000100:00100000:3.0:1787384426.066712:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:5568:x1874208173866240:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.067038:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:5568:x1874208173866240:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 338us (4018us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384426.067046:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 236 00000100:00100000:0.0:1787384426.071691:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384426.081596:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173866368 00000100:00100000:3.0:1787384426.081610:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173866368 00000100:00100000:3.0:1787384426.081676:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 237 00000100:00100000:3.0:1787384426.081698:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:5568:x1874208173866368:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.081951:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:5568:x1874208173866368:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 253us (10266us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384426.081959:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 237 10000000:01000000:3.0:1787384426.197983:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384426.197993:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e349e43000 from 7 10000000:01000000:3.0:1787384426.197998:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384426.198045:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.198057:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.198067:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384426.198094:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195921920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.198160:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384426.198215:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2afa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384426.198333:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195921920 00000100:00100000:2.0:1787384426.198340:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195921920 00000100:00100000:2.0:1787384426.198391:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1787384426.198401:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195921920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384426.198415:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384426.198429:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e366120600/0x3522fbed3b6c3452 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c344b expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384426.198452:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e366120600/0x3522fbed3b6c3452 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c344b expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384426.198474:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e366120600/0x3522fbed3b6c3452 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c344b expref: 17 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384426.198483:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120600, rc 0) 00000100:00100000:2.0:1787384426.198525:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195921920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384426.198532:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787384426.198612:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195921920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384426.198625:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.198633:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384426.198694:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.198975:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384426.199012:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2afa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384426.199049:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195922048 00000100:00100000:2.0:1787384426.199054:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195922048 00000100:00100000:2.0:1787384426.199084:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1787384426.199091:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195922048:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384426.199310:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195922048:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 219us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384426.199316:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787384426.199432:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922048:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.199460:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922176:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.199491:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384426.199507:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195922176 00000100:00100000:3.0:1787384426.199510:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195922176 00000100:00100000:3.0:1787384426.199529:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787384426.199535:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195922176:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.199661:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195922176:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 116us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384426.199668:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787384426.199696:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2afa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384426.199725:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922176:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384426.200328:0:11044:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787384426.200375:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787384426.200389:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384426.200397:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.200406:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384426.200416:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787384426.200419:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e3450ec800 from 7 10000000:01000000:3.0:1787384426.200421:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384426.200444:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.200463:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.200472:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384426.200487:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.200521:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384426.200537:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2af840 going to sleep for 11 seconds 00000100:00100000:3.0:1787384426.200551:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195922304 00000100:00100000:3.0:1787384426.200555:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195922304 00000100:00100000:3.0:1787384426.200579:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787384426.200585:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195922304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384426.200594:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384426.200605:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340031400/0x3522fbed3b6c3460 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3459 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.200623:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340031400/0x3522fbed3b6c3460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3459 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.200633:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340031400/0x3522fbed3b6c3460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3459 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.200641:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031400, rc 0) 00000100:00100000:3.0:1787384426.200669:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195922304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384426.200675:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1787384426.200725:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384426.200736:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.200744:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384426.200779:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.200802:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384426.200814:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2af840 going to sleep for 11 seconds 00000100:00100000:3.0:1787384426.200824:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195922432 00000100:00100000:3.0:1787384426.200827:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195922432 00000100:00100000:3.0:1787384426.200845:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787384426.200852:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195922432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.201060:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195922432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384426.201067:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1787384426.201095:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.201119:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.201152:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384426.201164:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787384426.201175:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195922560 00000100:00100000:3.0:1787384426.201178:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195922560 00000100:00100000:3.0:1787384426.201198:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787384426.201204:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195922560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.201324:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195922560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 120us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384426.201338:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1787384426.201371:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922560:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384426.204326:0:11045:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1787384426.205166:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1787384426.205188:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787384426.205199:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384426.205211:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384426.205222:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787384426.205224:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e348611800 from 7 10000000:01000000:1.0:1787384426.205227:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787384426.205263:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384426.205271:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384426.205281:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384426.205305:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787384426.205369:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384426.205407:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3779cd180 going to sleep for 11 seconds 00000100:00100000:3.0:1787384426.205530:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195922688 00000100:00100000:3.0:1787384426.205538:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195922688 00000100:00100000:3.0:1787384426.205590:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787384426.205600:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195922688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384426.205613:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384426.205626:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340030200/0x3522fbed3b6c346e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c3467 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.205647:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340030200/0x3522fbed3b6c346e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c3467 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.205825:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340030200/0x3522fbed3b6c346e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3467 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.205835:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030200, rc 0) 00000100:00100000:3.0:1787384426.205907:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195922688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 308us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384426.205914:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1787384426.205961:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384426.205976:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.205985:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384426.206051:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.206077:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384426.206099:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384426.206150:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195922816 00000100:00100000:2.0:1787384426.206155:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195922816 00000100:00100000:2.0:1787384426.206184:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1787384426.206192:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195922816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384426.206425:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195922816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384426.206432:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1787384426.206502:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.206531:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384426.206566:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384426.206594:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384426.207048:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195922944 00000100:00100000:2.0:1787384426.207054:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195922944 00000100:00100000:2.0:1787384426.207083:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1787384426.207090:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195922944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384426.207253:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195922944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 163us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384426.207266:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1787384426.207644:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195922944:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787384426.213667:0:11047:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787384426.213910:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787384426.213931:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787384426.213943:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384426.213955:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384426.519136:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384427.178548:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384427.178581:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384427.178598:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384427.178634:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173866624 00000100:00100000:3.0:1787384427.178642:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173866624 00000100:00100000:3.0:1787384427.178691:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173866752 00000100:00100000:3.0:1787384427.178694:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173866752 00000100:00100000:3.0:1787384427.178723:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 94 00000100:00100000:3.0:1787384427.178731:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173866624:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384427.178798:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173866624:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 67us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384427.178815:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 94 00000100:00100000:3.0:1787384427.178831:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 95 00000100:00100000:3.0:1787384427.178837:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173866752:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384427.180298:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173866752:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 23us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384427.180310:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 95 00000100:00100000:3.0:1787384427.180345:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173866496 00000100:00100000:3.0:1787384427.180352:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173866496 00000100:00100000:3.0:1787384427.180397:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 247 00000100:00100000:3.0:1787384427.180404:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173866496:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384427.180447:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173866496:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 44us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384427.180453:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 247 00000100:00080000:3.0:1787384427.180478:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787384427.534631:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384428.553191:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384429.129208:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384429.129245:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195923072:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384429.129338:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384429.129377:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195923072 00000100:00100000:1.0:1787384429.129388:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195923072 00000100:00100000:1.0:1787384429.129466:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787384429.129484:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195923072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384429.129532:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384429.129600:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbda300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195923072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384429.129608:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:1.0:1787384429.129635:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384429.129671:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e377b4e300 x1874208195923072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384445 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384429.129702:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195923072:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1787384429.198675:0:11213:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787384429.577110:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384429.641188:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195923456:0@lo:400:kworker.0 00000100:00100000:2.0:1787384429.641277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384429.641460:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195923328:0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.641493:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384429.641521:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384429.641527:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195923200:0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.641554:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384429.641594:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195923456 00000100:00100000:1.0:1787384429.641601:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195923456 00000100:00100000:1.0:1787384429.641650:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195923328 00000100:00100000:1.0:1787384429.641654:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195923328 00000100:00100000:1.0:1787384429.641679:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1787384429.641697:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195923456:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1787384429.641950:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384429.641963:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195923200 00000100:00100000:0.0:1787384429.641968:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195923200 00000100:00100000:0.0:1787384429.641997:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787384429.642004:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3307:x1874208195923200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.642044:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3307:x1874208195923200:12345-0@lo:400:kworker.0 Request processed in 41us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384429.642052:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1787384429.642090:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787384429.642097:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195923328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.642124:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195923328:12345-0@lo:400:kworker.0 Request processed in 28us (630us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384429.642130:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787384429.642173:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195923200:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.642188:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195923328:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.642253:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195923584:0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.642282:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384429.642309:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195923584 00000100:00100000:0.0:1787384429.642313:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195923584 00000100:00100000:0.0:1787384429.642339:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787384429.642345:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195923584:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384429.642378:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbdb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195923584:12345-0@lo:400:kworker.0 Request processed in 33us (95us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384429.642398:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:0.0:1787384429.642415:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384429.642444:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195923584:0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.643077:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195923456:12345-0@lo:400:kworker.0 Request processed in 1387us (1798us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384429.643086:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1787384429.643631:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195923456:0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.643878:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195923712:0@lo:400:kworker.0 00000100:00100000:1.0:1787384429.643927:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384429.644099:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195923712 00000100:00100000:3.0:1787384429.644106:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195923712 00000100:00100000:3.0:1787384429.644297:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1787384429.644306:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195923712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384429.644357:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195923712:12345-0@lo:400:kworker.0 Request processed in 52us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384429.644364:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1787384429.644585:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787384429.644614:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e372cd4a80 x1874208195923712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384429.644645:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195923712:0@lo:400:kworker.0 00000100:00100000:1.0:1787384430.154535:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195923840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384430.154611:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384430.155415:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195923840 00000100:00100000:2.0:1787384430.155423:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195923840 00000100:00100000:2.0:1787384430.155482:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787384430.155491:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195923840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384430.155524:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384430.155582:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195923840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384430.155589:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1787384430.155724:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eeed80 x1874208195923840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384446 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384430.155758:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195923840:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787384430.603764:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384431.631988:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384432.293061:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384432.293104:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384432.293133:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384432.293164:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173866880 00000100:00100000:1.0:1787384432.293176:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173866880 00000100:00100000:1.0:1787384432.293244:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 249 00000100:00100000:1.0:1787384432.293255:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173866880:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384432.293344:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173866880:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 90us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384432.293353:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 249 00000100:00100000:1.0:1787384432.293396:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173867008 00000100:00100000:1.0:1787384432.293400:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173867008 00000100:00100000:1.0:1787384432.293439:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173867136 00000100:00100000:1.0:1787384432.293442:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173867136 00000100:00100000:1.0:1787384432.293469:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00100000:1.0:1787384432.293476:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173867008:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384432.293510:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173867008:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 35us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384432.293516:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00100000:1.0:1787384432.293530:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 100 00000100:00100000:1.0:1787384432.293536:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173867136:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384432.293578:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173867136:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 42us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384432.293585:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 100 00000100:00080000:1.0:1787384432.293733:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787384432.655919:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787384433.038821:0:11312:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 03:40:30 (1787384430) === 00000100:00100000:1.0:1787384433.241838:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384433.241914:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384433.242029:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173867264 00000100:00100000:2.0:1787384433.242043:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173867264 00000100:00100000:0.0:1787384433.242075:0:5792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173867392 00000100:00100000:0.0:1787384433.242080:0:5792:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173867392 00000100:00100000:2.0:1787384433.242113:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:0.0:1787384433.242114:0:5792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1787384433.242125:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173867264:12345-192.168.203.51@tcp:41:mkdir.0 00000100:00100000:0.0:1787384433.242125:0:5792:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ddc9253f-47aa-4509-981d-645f91ec7250+7:9650:x1874208173867392:12345-192.168.203.51@tcp:700:mkdir.0 00000004:00000024:2.0:1787384433.242184:0:5784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787384433.242517:0:5792:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:ddc9253f-47aa-4509-981d-645f91ec7250+7:9650:x1874208173867392:12345-192.168.203.51@tcp:700:mkdir.0 Request processed in 393us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384433.242527:0:5792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1787384433.247459:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173867264:12345-192.168.203.51@tcp:41:mkdir.0 Request processed in 5326us (5627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384433.247476:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1787384433.247943:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384433.248014:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173867648 00000100:00100000:3.0:1787384433.248031:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173867648 00000100:00100000:3.0:1787384433.248103:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:3.0:1787384433.248115:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:9650:x1874208173867648:12345-192.168.203.51@tcp:36:mkdir.0 00010000:00010000:3.0:1787384433.248778:0:7691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384433.248824:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108be00/0x3522fbed3b6c3356 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c33 expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.248850:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4100) 00010000:00010000:3.0:1787384433.249479:0:7691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384433.252001:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3475 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.252034:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3475 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.252050:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3475 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.252068:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.252075:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.252083:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384433.264194:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787384433.264224:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3475 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.264238:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3475 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.264247:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3475 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.264254:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384433.264260:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3475 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.264270:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3475 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.264290:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a000) 00010000:00010000:3.0:1787384433.264293:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384433.264297:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3475 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.264303:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3475 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384433.264327:0:7691:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b3211f75 reply state 0000000015b64f49 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384433.264335:0:7691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384433.264466:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:9650:x1874208173867648:12345-192.168.203.51@tcp:36:mkdir.0 Request processed in 16349us (16519us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787384433.264486:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00010000:00010000:1.0:1787384433.273089:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.273113:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.273121:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.273128:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384433.273134:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.273143:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.273170:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89e34836a500) 00010000:00010000:1.0:1787384433.273174:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384433.273183:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.273191:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c347c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384433.285762:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384433.287217:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173867776 00000100:00100000:0.0:1787384433.287233:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173867776 00000100:00100000:0.0:1787384433.287315:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:0.0:1787384433.287327:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:9651:x1874208173867776:12345-192.168.203.51@tcp:101:chmod.0 00010000:00010000:0.0:1787384433.287355:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384433.287544:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3483 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78cb8 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.287636:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c348a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.287652:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c348a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.287674:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c348a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384433.287767:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1787384433.287772:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384433.287822:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c348a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.287854:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3483 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb8 expref: 8 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.287940:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c348a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb8 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.287951:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4a00) 00010000:00010000:0.0:1787384433.287954:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384433.287958:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ac00, rc 0) 00000100:00100000:0.0:1787384433.288082:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+7:9651:x1874208173867776:12345-192.168.203.51@tcp:101:chmod.0 Request processed in 756us (2334us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384433.288090:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1787384433.302677:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384433.302760:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173868032 00000100:00100000:0.0:1787384433.302774:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173868032 00000100:00100000:0.0:1787384433.302846:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:0.0:1787384433.302857:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:9651:x1874208173868032:12345-192.168.203.51@tcp:36:chmod.0 00010000:00010000:0.0:1787384433.302961:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384433.302997:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c348a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb8 expref: 7 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.303021:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4a00) 00010000:00010000:0.0:1787384433.303034:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384433.303086:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.303101:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.303112:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384433.303532:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ad4150a5 reply state 00000000d27532c1 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384433.303546:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787384433.303563:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1787384433.303690:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:9651:x1874208173868032:12345-192.168.203.51@tcp:36:chmod.0 Request processed in 834us (1037us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787384433.303699:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00010000:00010000:3.0:1787384433.312718:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.312744:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.312753:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.312759:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384433.312765:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.312775:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.312797:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4600) 00010000:00010000:3.0:1787384433.312801:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787384433.312806:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.312812:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3491 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384433.343034:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384433.343088:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173868160 00000100:00100000:1.0:1787384433.343101:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173868160 00000100:00100000:1.0:1787384433.343452:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:1.0:1787384433.343467:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:9652:x1874208173868160:12345-192.168.203.51@tcp:101:chown.0 00010000:00010000:1.0:1787384433.343502:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384433.343545:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3498 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78cbf expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.343643:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c349f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.343660:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c349f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.343685:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c349f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384433.343771:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787384433.343776:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787384433.343830:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c349f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.344023:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3498 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cbf expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.344045:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c349f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cbf expref: 8 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.344055:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e346919900) 00010000:00010000:1.0:1787384433.344058:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384433.344069:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c600, rc 0) 00000100:00100000:1.0:1787384433.344163:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:9652:x1874208173868160:12345-192.168.203.51@tcp:101:chown.0 Request processed in 701us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384433.344171:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:1.0:1787384433.347195:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384433.347320:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173868288 00000100:00100000:2.0:1787384433.347334:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173868288 00000100:00100000:2.0:1787384433.347406:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1787384433.347417:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:9652:x1874208173868288:12345-192.168.203.51@tcp:101:chown.0 00010000:00010000:2.0:1787384433.347444:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384433.347473:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c34a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78cc6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347567:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c34ad lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347586:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c34ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347610:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c34ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347631:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c34b4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347638:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c34b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347646:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c34b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347788:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c34bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347798:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c34bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347829:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c34bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384433.347919:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787384433.347923:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384433.347957:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c34bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347973:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c34ad lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347980:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c34ad lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347987:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c34ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.347994:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120a00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384433.347999:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c34ad lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348008:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c34ad lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348022:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e346919900) 00010000:00010000:2.0:1787384433.348026:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384433.348031:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c34ad lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348039:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c34ad lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348067:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c34b4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348073:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c34b4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348079:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c34b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348085:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384433.348088:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c34b4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348095:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c34b4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348103:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89e345695900) 00010000:00010000:2.0:1787384433.348106:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384433.348109:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c34b4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348115:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c34b4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348159:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c34a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cc6 expref: 10 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348175:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c34bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cc6 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.348208:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e345695300) 00010000:00010000:2.0:1787384433.348211:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384433.348213:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121400, rc 0) 00000100:00100000:2.0:1787384433.348300:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:9652:x1874208173868288:12345-192.168.203.51@tcp:101:chown.0 Request processed in 884us (1129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384433.348308:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:3.0:1787384433.360362:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384433.360403:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173868544 00000100:00100000:3.0:1787384433.360416:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173868544 00000100:00100000:3.0:1787384433.360491:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:3.0:1787384433.360511:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:9652:x1874208173868544:12345-192.168.203.51@tcp:36:chown.0 00010000:00010000:3.0:1787384433.360727:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384433.360766:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c34bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cc6 expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.360789:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e345695300) 00010000:00010000:3.0:1787384433.360807:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384433.360840:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.360854:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.360886:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384433.447782:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:1.0:1787384433.447807:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1787384433.447936:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087f0f236 reply state 00000000dd04224c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384433.447953:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787384433.448187:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1787384433.448328:0:5785:0:(ldlm_lib.c:3441:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1787384433.448351:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+7:9652:x1874208173868544:12345-192.168.203.51@tcp:36:chown.0 Request processed in 87836us (87996us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787384433.448361:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00010000:00010000:0.0:1787384433.448849:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.448892:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.448901:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.448907:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384433.448913:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.448921:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.448959:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e34836a000) 00010000:00010000:0.0:1787384433.448963:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787384433.448969:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.448976:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384433.475466:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384433.475895:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173868672 00000100:00100000:0.0:1787384433.475910:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173868672 00000100:00100000:0.0:1787384433.475989:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:0.0:1787384433.476002:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:9653:x1874208173868672:12345-192.168.203.51@tcp:101:touch.500 00010000:00010000:0.0:1787384433.476035:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384433.476062:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c34c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ccd expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384433.487411:0:5783:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 11274us 00010000:00010000:3.0:1787384433.503152:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c34d0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.503180:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c34d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.503262:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c34d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.503289:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34d7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.503297:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.503303:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.503993:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c34de lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504006:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c34de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504014:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c34de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384433.504102:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787384433.504107:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384433.504285:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c34de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504300:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c34d0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504308:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c34d0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504315:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c34d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504321:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384433.504326:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c34d0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504335:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c34d0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504350:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e346919900) 00010000:00010000:3.0:1787384433.504360:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384433.504366:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c34d0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504372:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c34d0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504459:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34d7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504466:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34d7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504472:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504476:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384433.504479:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34d7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504485:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34d7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504493:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89e34836a400) 00010000:00010000:3.0:1787384433.504495:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384433.504498:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34d7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504503:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c34d7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504553:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c34c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ccd expref: 8 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504582:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c34de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ccd expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.504590:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e34836a800) 00010000:00010000:3.0:1787384433.504592:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787384433.504595:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031000, rc 0) 00000100:00100000:3.0:1787384433.504700:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:9653:x1874208173868672:12345-192.168.203.51@tcp:101:touch.500 Request processed in 28699us (29307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384433.504710:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:1.0:1787384433.511642:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384433.515034:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173868928 00000100:00100000:3.0:1787384433.515054:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173868928 00000100:00100000:0.0:1787384433.519111:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:0.0:1787384433.519129:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:9653:x1874208173868928:12345-192.168.203.51@tcp:101:touch.500 00010000:00010000:0.0:1787384433.519159:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384433.519189:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c34e5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78cd4 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.519650:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c34ec lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.519677:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c34ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.519703:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c34ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.522469:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.522492:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.522504:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384433.528680:0:5784:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1787384433.528992:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c34fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529009:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c34fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529023:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c34fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529060:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c34ec lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529068:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c34ec lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529075:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c34ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529082:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384433.529094:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c34ec lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529101:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c34ec lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529113:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e34836a800) 00010000:00010000:0.0:1787384433.529116:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384433.529119:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c34ec lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529126:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c34ec lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384433.529140:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d881f3e reply state 00000000d15f1628 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384433.529149:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787384433.529185:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c34e5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cd4 expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529198:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c34fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cd4 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.529204:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89e343ce4e00) 00010000:00010000:0.0:1787384433.529207:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384433.529209:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b400, rc 0) 00000100:00100000:0.0:1787384433.529277:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+10:9653:x1874208173868928:12345-192.168.203.51@tcp:101:touch.500 Request processed in 10152us (17649us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787384433.529285:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00010000:00010000:3.0:1787384433.531780:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.531803:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.531811:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.531817:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384433.531823:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.531831:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.531850:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff89e343ce4a00) 00010000:00010000:3.0:1787384433.531905:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384433.531912:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.531919:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c34f3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384433.535368:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384433.535453:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173869184 00000100:00100000:3.0:1787384433.535467:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173869184 00000100:00100000:3.0:1787384433.535682:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:3.0:1787384433.535696:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+9:9653:x1874208173869184:12345-192.168.203.51@tcp:36:touch.500 00010000:00010000:3.0:1787384433.535779:0:7691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384433.535814:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c34fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cd4 expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.535836:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89e343ce4e00) 00010000:00010000:3.0:1787384433.535849:0:7691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384433.535946:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.535964:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.535975:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384433.536158:0:7691:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086e0a94d reply state 00000000dd25ee9f transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384433.536170:0:7691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384433.536292:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+10:9653:x1874208173869184:12345-192.168.203.51@tcp:36:touch.500 Request processed in 599us (944us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787384433.536318:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00010000:00010000:0.0:1787384433.544795:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.544814:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.544823:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.544829:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384433.544835:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.544842:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.544887:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89e34836a400) 00010000:00010000:0.0:1787384433.544891:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384433.544896:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.544902:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3508 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384433.549001:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384433.549195:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173869312 00000100:00100000:2.0:1787384433.549212:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173869312 00000100:00100000:2.0:1787384433.549293:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:2.0:1787384433.549304:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:9653:x1874208173869312:12345-192.168.203.51@tcp:101:touch.500 00010000:00010000:2.0:1787384433.549329:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384433.549353:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c350f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78cdb expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.549413:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c350f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cdb expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.549442:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c350f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cdb expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.549462:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89e345695900) 00010000:00010000:2.0:1787384433.549466:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384433.549469:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121200, rc 0) 00000100:00100000:2.0:1787384433.549539:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+10:9653:x1874208173869312:12345-192.168.203.51@tcp:101:touch.500 Request processed in 238us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384433.549547:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:1.0:1787384433.555016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384433.555118:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173869440 00000100:00100000:3.0:1787384433.555131:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173869440 00000100:00100000:3.0:1787384433.555182:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1787384433.555201:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874208173869440:12345-192.168.203.51@tcp:8:touch.500 00010000:00080000:3.0:1787384433.555245:0:6575:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp t0 exp 0000000000000000 cur 294 last 0 00000020:00000080:3.0:1787384433.555287:0:6575:0:(genops.c:1406:class_connect()) connect: client ddc9253f-47aa-4509-981d-645f91ec7250, cookie 0x3522fbed3b6c3516 00002000:00100000:3.0:1787384433.555304:0:6575:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ddc9253f-47aa-4509-981d-645f91ec7250/ffff89e373380800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787384433.555334:0:6575:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787384433.555634:0:6575:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787384433.555682:0:6575:0:(import.c:65:import_set_state_nolock()) ffff89e37b8f7000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384433.555773:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2349:x1874208173869440:12345-192.168.203.51@tcp:8:touch.500 Request processed in 581us (771us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384433.555783:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1787384433.558300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384433.558559:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173869568 00000100:00100000:2.0:1787384433.558572:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173869568 00000100:00080000:1.0:1787384433.558713:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384433.558810:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:2.0:1787384433.558822:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:0:x1874208173869568:12345-192.168.203.51@tcp:2:touch.500 00000001:00080000:1.0:1787384433.605913:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:1.0:1787384433.605941:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000100:00100000:3.0:1787384433.606189:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:0:x1874208173869568:12345-192.168.203.51@tcp:2:touch.500 Request processed in 47360us (47892us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1787384433.606213:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1787384433.609759:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384433.609849:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173869824 00000100:00100000:0.0:1787384433.609894:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173869824 00000100:00100000:0.0:1787384433.609967:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:0.0:1787384433.609978:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+10:9653:x1874208173869824:12345-192.168.203.51@tcp:35:touch.500 00000100:00100000:0.0:1787384433.610437:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+11:9653:x1874208173869824:12345-192.168.203.51@tcp:35:touch.500 Request processed in 456us (687us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787384433.610446:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:3.0:1787384433.619482:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384433.619565:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173869952 00000100:00100000:2.0:1787384433.619578:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173869952 00000100:00100000:2.0:1787384433.619675:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:2.0:1787384433.619687:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+11:9654:x1874208173869952:12345-192.168.203.51@tcp:101:rm.0 00010000:00010000:2.0:1787384433.619719:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384433.619747:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c351d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ce2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.619837:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3524 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.619853:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.619924:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384433.620008:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787384433.620013:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384433.620063:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3524 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.620098:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c351d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ce2 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.620121:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3524 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ce2 expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.620131:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e34836a800) 00010000:00010000:2.0:1787384433.620134:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384433.620138:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120c00, rc 0) 00000100:00100000:2.0:1787384433.620996:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+12:9654:x1874208173869952:12345-192.168.203.51@tcp:101:rm.0 Request processed in 1304us (1523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384433.621007:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:3.0:1787384433.624854:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384433.625104:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173870208 00000100:00100000:2.0:1787384433.625117:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173870208 00000100:00100000:2.0:1787384433.625206:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:2.0:1787384433.625219:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+12:9654:x1874208173870208:12345-192.168.203.51@tcp:101:rm.0 00010000:00010000:2.0:1787384433.625253:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384433.625284:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c352b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ce9 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384433.625810:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787384433.626090:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c352b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ce9 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.626111:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e346919900) 00010000:00010000:2.0:1787384433.626114:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384433.626119:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c352b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ce9 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.626136:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120e00, rc 0) 00000100:00100000:2.0:1787384433.626220:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+13:9654:x1874208173870208:12345-192.168.203.51@tcp:101:rm.0 Request processed in 1003us (1381us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1787384433.626229:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:1.0:1787384433.630450:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384433.630806:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173870336 00000100:00100000:3.0:1787384433.630820:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173870336 00000100:00100000:3.0:1787384433.630919:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:3.0:1787384433.630932:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+13:9654:x1874208173870336:12345-192.168.203.51@tcp:37:rm.0 00000100:00100000:2.0:1787384433.642683:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+13:9654:x1874208173870336:12345-192.168.203.51@tcp:37:rm.0 Request processed in 11662us (12155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384433.642712:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:1.0:1787384433.646337:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384433.646563:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173870592 00000100:00100000:2.0:1787384433.646576:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173870592 00000100:00100000:2.0:1787384433.646764:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:2.0:1787384433.646777:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350fb8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+13:9654:x1874208173870592:12345-192.168.203.51@tcp:35:rm.0 00000100:00100000:2.0:1787384433.647152:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350fb8850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+14:9654:x1874208173870592:12345-192.168.203.51@tcp:35:rm.0 Request processed in 375us (828us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1787384433.647161:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:1.0:1787384433.650057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384433.650169:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173870848 00000100:00100000:3.0:1787384433.650208:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173870848 00000100:00100000:3.0:1787384433.650285:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:3.0:1787384433.650297:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+14:9654:x1874208173870848:12345-192.168.203.51@tcp:101:rm.0 00010000:00010000:3.0:1787384433.650328:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384433.650353:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3539 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78cf0 expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.650527:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3540 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.650544:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.650558:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3540 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384433.650571:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1787384433.650797:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3539 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cf0 expref: 17 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.650821:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3540 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cf0 expref: 16 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.650830:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e34836a800) 00010000:00010000:3.0:1787384433.650832:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787384433.650836:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030000, rc 0) 00000100:00100000:3.0:1787384433.650962:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+16:9654:x1874208173870848:12345-192.168.203.51@tcp:101:rm.0 Request processed in 666us (918us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1787384433.650971:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:1.0:1787384433.655224:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384433.655450:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173870976 00000100:00100000:0.0:1787384433.655464:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173870976 00000100:00100000:0.0:1787384433.655721:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:0.0:1787384433.655734:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+16:9654:x1874208173870976:12345-192.168.203.51@tcp:41:rm.0 00000004:00000024:0.0:1787384433.655816:0:5784:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1787384433.655931:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343068a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+16:9654:x1874208173870976:12345-192.168.203.51@tcp:41:rm.0 Request processed in 199us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384433.655939:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:3.0:1787384433.658158:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384433.659019:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173871104 00000100:00100000:2.0:1787384433.659037:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173871104 00000100:00100000:2.0:1787384433.659185:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:2.0:1787384433.659207:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+16:9654:x1874208173871104:12345-192.168.203.51@tcp:101:rm.0 00010000:00010000:2.0:1787384433.659235:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384433.659263:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c354e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78cf7 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659352:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3555 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659368:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3555 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659393:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3555 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659409:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c355c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659416:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c355c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659422:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c355c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659571:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3563 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659580:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659587:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384433.659832:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787384433.659837:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384433.659883:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659897:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3563 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659906:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3555 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659911:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3555 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659918:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659924:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120a00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384433.659928:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3555 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659936:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3555 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659950:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e34836a800) 00010000:00010000:2.0:1787384433.659953:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384433.659958:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3555 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659964:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3555 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659992:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c355c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.659997:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c355c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.660002:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c355c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.660007:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384433.660010:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c355c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.660015:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c355c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.660022:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff89e345695e00) 00010000:00010000:2.0:1787384433.660025:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384433.660027:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c355c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.660033:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c355c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.660075:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c354e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cf7 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.660090:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3563 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cf7 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.660109:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89e345695900) 00010000:00010000:2.0:1787384433.660112:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384433.660114:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121e00, rc 0) 00000100:00100000:2.0:1787384433.660210:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+17:9654:x1874208173871104:12345-192.168.203.51@tcp:101:rm.0 Request processed in 1014us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384433.660219:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:1.0:1787384433.663781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384433.664017:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173871360 00000100:00100000:0.0:1787384433.664031:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173871360 00000100:00100000:2.0:1787384433.664217:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:2.0:1787384433.664230:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+17:9654:x1874208173871360:12345-192.168.203.51@tcp:36:rm.0 00010000:00010000:2.0:1787384433.664310:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787384433.664345:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3563 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cf7 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664369:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c350f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cdb expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664394:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89e345695900) 00010000:00010000:2.0:1787384433.664420:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3524 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ce2 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664431:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e34836a800) 00010000:00010000:2.0:1787384433.664434:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384433.664463:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c356a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664478:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c356a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664685:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c356a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664705:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664712:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664717:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664976:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3578 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664985:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3578 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.664993:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3578 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384433.666819:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1787384433.666838:0:5783:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 294809977760ns, next at 295809974631ns, rc = 0 00010000:00010000:2.0:1787384433.667086:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667105:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667116:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667139:0:5783:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667147:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667152:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667242:0:5783:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384433.667270:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3578 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667277:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3578 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667283:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3578 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667289:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384433.667293:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3578 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667301:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3578 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667314:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89e345695400) 00010000:00010000:2.0:1787384433.667317:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787384433.667321:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3578 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667338:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3578 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667361:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c356a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667367:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c356a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667372:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c356a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667388:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384433.667391:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c356a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667397:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c356a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667405:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e34836a800) 00010000:00010000:2.0:1787384433.667408:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384433.667411:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c356a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.667417:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c356a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384433.667427:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000220bfe52 reply state 00000000ddd8750a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384433.667438:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384433.667566:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343069f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+16:9654:x1874208173871360:12345-192.168.203.51@tcp:36:rm.0 Request processed in 3332us (3794us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787384433.667576:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 30 00010000:00010000:3.0:1787384433.671712:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.671734:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.671743:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.671749:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384433.671754:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.671763:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.671783:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x48a8de3 (ffff89e345695000) 00010000:00010000:3.0:1787384433.671787:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384433.671793:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384433.671799:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121600/0x3522fbed3b6c3571 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x48a8de3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384433.672356:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384433.672842:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173871616 00000100:00100000:2.0:1787384433.672855:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173871616 00000100:00100000:2.0:1787384433.672945:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:2.0:1787384433.672956:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+15:9654:x1874208173871616:12345-192.168.203.51@tcp:35:rm.0 00000100:00100000:2.0:1787384433.673988:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+16:9654:x1874208173871616:12345-192.168.203.51@tcp:35:rm.0 Request processed in 1022us (1630us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787384433.674001:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00010000:00010000:0.0:1787384433.674150:0:8292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384433.674161:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.674172:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384433.674178:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.674188:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.674215:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff89e345695400) 00010000:00010000:0.0:1787384433.674219:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787384433.674224:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384433.674230:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120200/0x3522fbed3b6c357f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384433.674388:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384433.674391:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384433.674393:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384433.674480:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384433.677528:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384433.677609:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173871872 00000100:00100000:2.0:1787384433.677622:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173871872 00000100:00100000:2.0:1787384433.677704:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:2.0:1787384433.677717:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+16:9654:x1874208173871872:12345-192.168.203.51@tcp:36:rm.0 00010000:00010000:2.0:1787384433.677795:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787384433.677829:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3540 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cf0 expref: 16 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.677891:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c34de lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ccd expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.677905:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e34836a800) 00010000:00010000:2.0:1787384433.677929:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c349f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cbf expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.677939:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e346919900) 00010000:00010000:2.0:1787384433.677963:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384433.677998:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c3586 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.678013:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c3586 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.678025:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c3586 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.678039:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.678046:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.678051:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.678441:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3594 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.678450:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.678457:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384433.679229:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1787384433.679250:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3594 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679259:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3594 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679273:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679279:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120a00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384433.679284:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3594 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679292:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3594 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679305:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff89e345695a00) 00010000:00010000:2.0:1787384433.679309:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1787384433.679312:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3594 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679319:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120a00/0x3522fbed3b6c3594 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679349:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c3586 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679356:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c3586 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679361:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c3586 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679366:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120e00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384433.679369:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c3586 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679385:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c3586 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679394:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e345695e00) 00010000:00010000:2.0:1787384433.679397:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384433.679399:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c3586 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.679405:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120e00/0x3522fbed3b6c3586 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384433.679418:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d2a46ae6 reply state 0000000093db4910 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384433.679429:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384433.681943:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+15:9654:x1874208173871872:12345-192.168.203.51@tcp:36:rm.0 Request processed in 4211us (4412us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787384433.681960:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 31 00010000:00010000:2.0:1787384433.692452:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.692477:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.692486:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.692492:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384433.692499:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.692533:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.692554:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff89e345695f00) 00010000:00010000:2.0:1787384433.692557:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384433.692562:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384433.692569:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120800/0x3522fbed3b6c358d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384434.251110:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384434.251144:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195923968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384434.251239:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384434.252047:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195923968 00000100:00100000:3.0:1787384434.252061:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195923968 00000100:00100000:3.0:1787384434.252155:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384434.252168:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195923968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384434.252221:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384434.252294:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343068000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195923968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1054us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.252320:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1787384434.252449:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384434.252489:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37bbd8700 x1874208195923968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384434.252527:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195923968:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787384434.697698:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384434.762634:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195924096:0@lo:400:kworker.0 00000100:00100000:2.0:1787384434.762742:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384434.762802:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195924608:0@lo:400:kworker.0 00000100:00100000:2.0:1787384434.762832:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384434.762878:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384434.762886:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195924480:0@lo:400:kworker.0 00000100:00100000:2.0:1787384434.762916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384434.762956:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195924096 00000100:00100000:2.0:1787384434.762966:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195924096 00000100:00100000:2.0:1787384434.763022:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787384434.763032:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195924096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384434.763088:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195924096:12345-0@lo:400:kworker.0 Request processed in 56us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384434.763095:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787384434.763132:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195924480 00000100:00100000:2.0:1787384434.763136:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195924480 00000100:00100000:2.0:1787384434.763191:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787384434.763197:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195924480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.763376:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195924224:0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.763480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384434.763503:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384434.763509:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195924352:0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.763531:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384434.763562:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195924608 00000100:00100000:3.0:1787384434.763566:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195924608 00000100:00100000:3.0:1787384434.763609:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384434.763616:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195924608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.763649:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195924608:12345-0@lo:400:kworker.0 Request processed in 34us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.763666:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787384434.763687:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195924224 00000100:00100000:3.0:1787384434.763691:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195924224 00000100:00100000:3.0:1787384434.763705:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195924352 00000100:00100000:3.0:1787384434.763707:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195924352 00000100:00100000:3.0:1787384434.763729:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787384434.763735:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195924224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.763790:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195924224:12345-0@lo:400:kworker.0 Request processed in 54us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.763798:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1787384434.763811:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787384434.763817:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195924352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.763844:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195924352:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384434.763856:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1787384434.763917:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195924352:0@lo:400:kworker.0 00000100:00100000:3.0:1787384434.763928:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195924224:0@lo:400:kworker.0 00000100:00100000:0.0:1787384434.764983:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eeed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195924096:0@lo:400:kworker.0 00010000:00080000:0.0:1787384434.765020:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eec380 x1874208195924608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384434.765032:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195924608:0@lo:400:kworker.0 00000100:00100000:2.0:1787384434.765632:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eeea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195924480:12345-0@lo:400:kworker.0 Request processed in 2431us (2712us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384434.765645:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:2.0:1787384434.765692:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384434.765698:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384434.772158:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195924480:0@lo:400:kworker.0 00000004:00080000:2.0:1787384435.274400:0:7838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 296417536743ns, next at 297417534167ns, rc = 0 00000100:00100000:3.0:1787384435.274512:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195924736:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384435.274610:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384435.274988:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195924736 00000100:00100000:2.0:1787384435.274997:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195924736 00000100:00100000:2.0:1787384435.275058:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787384435.275069:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195924736:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384435.275113:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384435.275170:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195924736:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384435.275177:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1787384435.275352:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e379eefb80 x1874208195924736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384451 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384435.275376:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eefb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195924736:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384435.721208:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384436.745140:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384437.417817:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384437.417994:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384437.418036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384437.418066:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384437.418108:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173872256 00000100:00100000:0.0:1787384437.418122:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173872256 00000100:00100000:0.0:1787384437.418214:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:0.0:1787384437.418226:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2352:x1874208173872256:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384437.418325:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2352:x1874208173872256:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 101us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384437.418333:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:2.0:1787384437.418502:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173872128 00000100:00100000:2.0:1787384437.418508:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173872128 00000100:00100000:2.0:1787384437.418550:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173872384 00000100:00100000:2.0:1787384437.418554:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173872384 00000100:00100000:2.0:1787384437.418586:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 104 00000100:00100000:2.0:1787384437.418607:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+14:2353:x1874208173872128:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384437.418666:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+14:2353:x1874208173872128:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 61us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384437.418673:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 104 00000100:00100000:2.0:1787384437.418689:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 105 00000100:00100000:2.0:1787384437.418695:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173872384:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384437.418735:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173872384:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 40us (699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384437.418742:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 105 00000100:00080000:2.0:1787384437.418765:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384437.418770:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384437.429943:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173872000 00000100:00100000:1.0:1787384437.429967:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173872000 00000100:00100000:1.0:1787384437.430074:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 251 00000100:00100000:1.0:1787384437.430087:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173872000:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384437.430206:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f78c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173872000:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 121us (12404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384437.430215:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 251 00010000:00010000:2.0:1787384437.770133:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787384437.906504:0:11462:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1787384438.793254:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787384438.895655:0:11511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffe108809d0 00000020:00000080:1.0:1787384438.895674:0:11511:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787384438.895680:0:11511:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787384438.895692:0:11511:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe10882c60 20000000:00000080:1.0:1787384438.895699:0:11511:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e3732d3000 uarg=0000000000000000 20000000:01000000:1.0:1787384438.895745:0:11511:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787384438.895752:0:11511:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1787384438.895758:0:11511:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1787384438.897757:0:11512:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1787384438.898000:0:11511:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1787384438.906235:0:11511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1787384438.906502:0:11511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1787384438.906571:0:11511:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1787384438.906594:0:11511:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787384438.906620:0:11511:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.906658:0:11511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c343d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78caa expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.906666:0:11511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c3444 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb1 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.906674:0:11511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e366120600/0x3522fbed3b6c3452 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c344b expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.906698:0:11511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e340031400/0x3522fbed3b6c3460 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3459 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.906704:0:11511:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e340030200/0x3522fbed3b6c346e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c3467 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.906712:0:11511:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.906761:0:11511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e340030200/0x3522fbed3b6c346e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c3467 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.906776:0:11511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e340030200/0x3522fbed3b6c346e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c3467 expref: 18 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384438.906795:0:11511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c39e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1874208195924864:0@lo:104: 00000100:00100000:3.0:1787384438.906895:0:11511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384438.906943:0:5766:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195924864 00000100:00100000:3.0:1787384438.906953:0:5766:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195924864 00000100:00100000:3.0:1787384438.907061:0:5766:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787384438.907073:0:5766:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:11511:x1874208195924864:12345-0@lo:104: 00010000:00010000:3.0:1787384438.907087:0:5766:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.907153:0:5766:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384438.907171:0:5766:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:11511:x1874208195924864:12345-0@lo:104: Request processed in 100us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384438.907179:0:5766:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:2.0:1787384438.908038:0:11511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e340031400/0x3522fbed3b6c3460 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c3459 expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384438.908053:0:11511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e340031400/0x3522fbed3b6c3460 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c3459 expref: 18 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384438.908066:0:11511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1874208195924992:0@lo:104: 00000100:00100000:2.0:1787384438.908126:0:11511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787384438.912061:0:11511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e366120600/0x3522fbed3b6c3452 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c344b expref: 18 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384438.912082:0:11511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff89e366120600/0x3522fbed3b6c3452 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c344b expref: 18 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384438.912100:0:11511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1874208195925120:0@lo:104: 00000100:00100000:2.0:1787384438.912185:0:11511:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384438.912294:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195924992 00000100:00100000:1.0:1787384438.912305:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195924992 00000100:00100000:1.0:1787384438.912372:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384438.912383:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:11511:x1874208195924992:12345-0@lo:104: 00010000:00010000:1.0:1787384438.912399:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.912471:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1787384438.912489:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eeed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:11511:x1874208195924992:12345-0@lo:104: Request processed in 108us (4362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384438.912497:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1787384438.912920:0:8292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384438.912931:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384438.912941:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624dc00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384438.912946:0:8292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384438.912957:0:8292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384438.912966:0:8292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384438.912980:0:8292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384438.913021:0:8292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384438.913028:0:8292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384438.913051:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384438.913058:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e36624dc00/0x3522fbed3b6c3467 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c346e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384438.913073:0:8292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384438.913081:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384438.913088:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3429d5c00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384438.913091:0:8292:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384438.913098:0:8292:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384438.913104:0:8292:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384438.913110:0:8292:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384438.913123:0:8292:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384438.913128:0:8292:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384438.913170:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384438.913177:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3429d5c00/0x3522fbed3b6c3459 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3460 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384438.913190:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384438.913193:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384438.913195:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384438.913667:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384438.913690:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195925376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384438.913752:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384438.913809:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195925376 00000100:00100000:1.0:1787384438.913815:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195925376 00010000:00010000:1.0:1787384438.913848:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e340031400/0x3522fbed3b6c3460 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3459 expref: 19 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384438.913901:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384438.913911:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195925376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384438.913925:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384438.913931:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e340031400/0x3522fbed3b6c3460 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3459 expref: 19 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.913942:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e340031400/0x3522fbed3b6c3460 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c3459 expref: 19 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.913966:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384438.913999:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195925376:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384438.914007:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384438.914052:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195925376:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384438.915132:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195925248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384438.915203:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384438.915273:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384438.915310:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195925248 00000100:00100000:1.0:1787384438.915316:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195925248 00010000:00010000:1.0:1787384438.915348:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e340030200/0x3522fbed3b6c346e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3467 expref: 19 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384438.915385:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384438.915394:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3307:x1874208195925248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384438.915406:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384438.915410:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e340030200/0x3522fbed3b6c346e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c3467 expref: 19 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.915422:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e340030200/0x3522fbed3b6c346e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c3467 expref: 19 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.915442:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384438.915478:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343069180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3307:x1874208195925248:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384438.915485:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384438.915524:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbdb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195925248:0@lo:103:ldlm_bl.0 00000001:00080000:1.0:1787384438.916832:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967302 is committed 00000004:00080000:1.0:1787384438.916854:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000001:00080000:1.0:1787384438.916896:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1787384438.916905:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:1.0:1787384438.917049:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195925504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787384438.917113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384438.917391:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195925504 00000100:00100000:3.0:1787384438.917399:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195925504 00000100:00100000:3.0:1787384438.917469:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787384438.917479:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195925504:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787384438.917512:0:6575:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1787384438.917554:0:6575:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a895270, atime: 0x6a895270, ctime: 0x6a895270, blocks: 0x1 00010000:00010000:3.0:1787384438.917563:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c35a2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.917581:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=300s v=(0 0) 00010000:00010000:3.0:1787384438.917585:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384438.917592:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c35a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.917612:0:6575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c35a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.917634:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c35a2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.917643:0:6575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c35a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.917665:0:6575:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1787384438.918259:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384438.918534:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195925504:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1055us (1418us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787384438.918543:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1787384438.918588:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384438.918595:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c35a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.918606:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd000 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384438.918612:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c35a2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.918623:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c35a2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.918653:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c35a2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.918661:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c35a2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.918684:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384438.918686:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384438.918688:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1787384438.919493:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e343069500/2, rc 0, transno 4294967300 00000100:00100000:0.0:1787384438.919505:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195925504:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1787384438.920108:0:5767:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787384438.920129:0:5767:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195925120 00000100:00100000:1.0:1787384438.920136:0:5767:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195925120 00000100:00100000:1.0:1787384438.920248:0:5767:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787384438.920271:0:5767:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b981050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:11511:x1874208195925120:12345-0@lo:104: 00010000:00010000:1.0:1787384438.920289:0:5767:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.920368:0:5767:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384438.920374:0:5767:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b981050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+3:11511:x1874208195925120:12345-0@lo:104: Request processed in 106us (8190us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384438.920382:0:5767:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787384438.920452:0:8293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384438.920458:0:8293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.920465:0:8293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3429d4c00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:1.0:1787384438.920469:0:8293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.920478:0:8293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384438.920485:0:8293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384438.920491:0:8293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787384438.920540:0:8293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.920547:0:8293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384438.920569:0:8293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.920586:0:8293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3429d4c00/0x3522fbed3b6c344b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c3452 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.920608:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384438.920610:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384438.920612:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384438.920639:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e34306b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195925632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384438.920682:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384438.920733:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195925632 00000100:00100000:1.0:1787384438.920738:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195925632 00010000:00010000:1.0:1787384438.920759:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e366120600/0x3522fbed3b6c3452 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c344b expref: 19 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384438.920783:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384438.920790:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195925632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384438.920801:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384438.920806:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e366120600/0x3522fbed3b6c3452 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c344b expref: 19 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.920816:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e366120600/0x3522fbed3b6c3452 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c344b expref: 19 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.920834:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384438.920895:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349e10c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195925632:12345-0@lo:103:ldlm_bl.0 Request processed in 105us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384438.920901:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384438.920962:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e34306b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195925632:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384438.921315:0:11511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c3444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb1 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384438.921331:0:11511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c3444 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb1 expref: 12 pid: 5777 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384438.921358:0:11511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1874208195925760:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384438.921478:0:11511:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c343d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78caa expref: 12 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384438.921486:0:11511:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c343d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78caa expref: 12 pid: 5778 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384438.921495:0:11511:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eeed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1874208195925888:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384438.921520:0:11511:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787384438.921537:0:11511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340030200/0x3522fbed3b6c346e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c3467 expref: 18 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384438.921551:0:11511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c39e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1874208195924864:0@lo:104: 00010000:00010000:2.0:1787384438.921566:0:11511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340031400/0x3522fbed3b6c3460 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c3459 expref: 17 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384438.921574:0:11511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1874208195924992:0@lo:104: 00010000:00010000:2.0:1787384438.921582:0:11511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e366120600/0x3522fbed3b6c3452 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c344b expref: 16 pid: 5777 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384438.921590:0:11511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1874208195925120:0@lo:104: 00000100:00100000:1.0:1787384438.930753:0:11511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eed880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1874208195925760:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384438.930772:0:11511:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eeed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11511:1874208195925888:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384438.930824:0:11511:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384438.936712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384438.936844:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173872512 00000100:00100000:0.0:1787384438.937013:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173872512 00010000:00010000:1.0:1787384438.937220:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c3444 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb1 expref: 13 pid: 5777 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384438.937315:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:1.0:1787384438.937327:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173872512:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384438.937347:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384438.937354:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c3444 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb1 expref: 13 pid: 5777 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.937370:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c3444 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb1 expref: 13 pid: 5777 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.937404:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c3444 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cb1 expref: 13 pid: 5777 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.937424:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384438.937527:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+12:2353:x1874208173872512:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 202us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384438.937536:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:2.0:1787384438.938136:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384438.938420:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173872640 00000100:00100000:1.0:1787384438.938429:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173872640 00010000:00010000:1.0:1787384438.938474:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c343d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78caa expref: 12 pid: 5778 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384438.938512:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:1.0:1787384438.938521:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96efe439-3b25-4671-a225-6795623d17b0+12:2352:x1874208173872640:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384438.938533:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384438.938539:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c343d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78caa expref: 12 pid: 5778 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938550:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c343d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78caa expref: 12 pid: 5778 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938567:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108a000/0x3522fbed3b6c343d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78caa expref: 12 pid: 5778 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938582:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938592:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938610:0:5770:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938619:0:5770:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938637:0:5770:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938646:0:5770:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938659:0:5770:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384438.938665:0:5770:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938674:0:5770:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938693:0:5770:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384438.938709:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384438.938754:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eefb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96efe439-3b25-4671-a225-6795623d17b0+11:2352:x1874208173872640:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 233us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384438.938763:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00010000:00010000:3.0:1787384438.939311:0:11511:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.939323:0:11511:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384438.939330:0:11511:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3413fd400/0x3522fbed3b6c359b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11511 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384439.369288:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195926016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384439.369397:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384439.369598:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195926016 00000100:00100000:0.0:1787384439.369610:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195926016 00000100:00100000:0.0:1787384439.369703:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787384439.369715:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195926016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384439.369774:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384439.369834:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195926016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (437us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384439.369842:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787384439.370065:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787384439.370111:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37bbd9f80 x1874208195926016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384455 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384439.370135:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbd9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195926016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787384439.818602:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384439.881615:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195926272:0@lo:400:kworker.0 00000100:00100000:0.0:1787384439.881722:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384439.881806:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384439.881816:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195926144:0@lo:400:kworker.0 00000100:00100000:0.0:1787384439.881849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384439.881932:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195926272 00000100:00100000:0.0:1787384439.881941:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195926272 00000100:00100000:0.0:1787384439.881995:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787384439.882004:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195926272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384439.882077:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195926272:12345-0@lo:400:kworker.0 Request processed in 73us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384439.882085:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787384439.882113:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195926144 00000100:00100000:0.0:1787384439.882116:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195926144 00000100:00100000:0.0:1787384439.882142:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787384439.882149:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3305:x1874208195926144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384439.882192:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f79050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3305:x1874208195926144:12345-0@lo:400:kworker.0 Request processed in 43us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384439.882199:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:0.0:1787384439.882254:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195926144:0@lo:400:kworker.0 00000100:00100000:0.0:1787384439.882270:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195926272:0@lo:400:kworker.0 00000100:00100000:2.0:1787384439.882813:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195926656:0@lo:400:kworker.0 00000100:00100000:2.0:1787384439.882854:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384439.882915:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384439.882922:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e34306aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195926784:0@lo:400:kworker.0 00000100:00100000:2.0:1787384439.882966:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384439.882981:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e34306a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195926400:0@lo:400:kworker.0 00000100:00100000:2.0:1787384439.883003:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195926784 00000100:00100000:2.0:1787384439.883009:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195926784 00000100:00100000:3.0:1787384439.883020:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384439.883045:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384439.883052:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e34306a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195926528:0@lo:400:kworker.0 00000100:00100000:2.0:1787384439.883067:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1787384439.883083:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195926784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.883084:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384439.883117:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195926528 00000100:00100000:3.0:1787384439.883122:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195926528 00000100:00100000:2.0:1787384439.883138:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195926784:12345-0@lo:400:kworker.0 Request processed in 62us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384439.883146:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787384439.883156:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787384439.883165:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195926528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.883209:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195926528:12345-0@lo:400:kworker.0 Request processed in 45us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384439.883210:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e34306aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195926784:0@lo:400:kworker.0 00000100:00100000:3.0:1787384439.883224:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787384439.883853:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195926656 00000100:00100000:1.0:1787384439.883884:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195926656 00000100:00100000:1.0:1787384439.883931:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195926400 00000100:00100000:1.0:1787384439.883935:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195926400 00000100:00100000:1.0:1787384439.883963:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787384439.883971:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195926656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384439.885429:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1787384439.885463:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195926400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384439.885552:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195926400:12345-0@lo:400:kworker.0 Request processed in 102us (2532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384439.885560:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:0.0:1787384439.885651:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787384439.885781:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e34306a300 x1874208195926528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384455 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384439.885799:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e34306a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195926528:0@lo:400:kworker.0 00000100:00100000:2.0:1787384439.885815:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e34306a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195926400:0@lo:400:kworker.0 00000100:00100000:1.0:1787384439.885937:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eeed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195926656:12345-0@lo:400:kworker.0 Request processed in 1965us (3080us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384439.885960:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787384439.887104:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343069c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195926656:0@lo:400:kworker.0 00000100:00100000:3.0:1787384440.396465:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195926912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384440.396766:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384440.397009:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195926912 00000100:00100000:0.0:1787384440.397020:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195926912 00000100:00100000:0.0:1787384440.397110:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384440.397119:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195926912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384440.397164:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384440.397235:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195926912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.397242:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1787384440.397551:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195926912:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787384440.397697:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384440.676023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384440.676117:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173872768 00000100:00100000:1.0:1787384440.676128:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173872768 00000100:00100000:1.0:1787384440.676209:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 253 00000100:00100000:1.0:1787384440.676219:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+11:5568:x1874208173872768:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384440.676235:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384440.676255:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c35a9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78cfe expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384440.676281:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c35a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cfe expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384440.676292:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c35a9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cfe expref: 12 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384440.676302:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d200, rc 0) 00000100:00100000:1.0:1787384440.676364:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f78450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173872768:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 147us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384440.676375:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 253 00000100:00100000:1.0:1787384440.679084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384440.679181:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173872896 00000100:00100000:0.0:1787384440.679191:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173872896 00000100:00100000:0.0:1787384440.679242:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 254 00000100:00100000:0.0:1787384440.679251:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173872896:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384440.679546:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173872896:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 295us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.679553:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 254 00000100:00100000:2.0:1787384440.685436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384440.685923:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173873024 00000100:00100000:0.0:1787384440.685933:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173873024 00000100:00100000:0.0:1787384440.686008:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 255 00000100:00100000:0.0:1787384440.686018:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e349f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173873024:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384440.686250:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e349f7a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173873024:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 232us (822us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.686258:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 255 00000100:00100000:2.0:1787384440.696955:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384440.697051:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173873152 00000100:00100000:1.0:1787384440.697060:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173873152 00000100:00100000:1.0:1787384440.697118:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 256 00000100:00100000:1.0:1787384440.697128:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+12:9924:x1874208173873152:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384440.697372:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+12:9924:x1874208173873152:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 245us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384440.697390:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 256 00000100:00100000:2.0:1787384440.701924:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384440.702229:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173873280 00000100:00100000:1.0:1787384440.702240:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173873280 00000100:00100000:1.0:1787384440.702298:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 257 00000100:00100000:1.0:1787384440.702309:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+12:9924:x1874208173873280:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384440.702570:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+12:9924:x1874208173873280:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 262us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384440.702578:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 257 00000100:00100000:2.0:1787384440.708759:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384440.709478:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173873408 00000100:00100000:0.0:1787384440.709488:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173873408 00000100:00100000:0.0:1787384440.709549:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 258 00000100:00100000:0.0:1787384440.709558:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+12:5568:x1874208173873408:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384440.709574:0:5777:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384440.709595:0:5777:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108be00/0x3522fbed3b6c35b0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d05 expref: -99 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384440.709654:0:5777:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108be00/0x3522fbed3b6c35b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d05 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384440.709665:0:5777:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108be00/0x3522fbed3b6c35b0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d05 expref: 13 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384440.709675:0:5777:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108be00, rc 0) 00000100:00100000:0.0:1787384440.709735:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:5568:x1874208173873408:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 176us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.709741:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 258 10000000:01000000:0.0:1787384440.712962:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787384440.712969:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e349e43000 from 7 10000000:01000000:0.0:1787384440.713102:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787384440.713252:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384440.713265:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384440.713277:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384440.713314:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbdb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927040:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384440.713501:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384440.713835:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3729e1300 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.715307:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195927040 00000100:00100000:2.0:1787384440.715318:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195927040 00000100:00100000:2.0:1787384440.715441:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1787384440.715452:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:5780:x1874208195927040:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384440.715468:0:5776:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384440.715509:0:5776:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e366120800/0x3522fbed3b6c35be lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c35b7 expref: -99 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.715543:0:5776:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e366120800/0x3522fbed3b6c35be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c35b7 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.715563:0:5776:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e366120800/0x3522fbed3b6c35be lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c35b7 expref: 17 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.715571:0:5776:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120800, rc 0) 00000100:00100000:2.0:1787384440.715655:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195927040:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (2153us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.715661:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787384440.715755:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbdb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927040:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384440.715772:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384440.715781:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384440.715848:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343068380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384440.715910:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384440.717321:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aef3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384440.717379:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195927168 00000100:00100000:0.0:1787384440.717387:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195927168 00000100:00100000:0.0:1787384440.717428:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787384440.717448:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195927168:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384440.717552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384440.717902:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195927168:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 454us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.717910:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1787384440.717935:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173873536 00000100:00100000:0.0:1787384440.717938:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173873536 00000100:00100000:0.0:1787384440.717956:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 261 00000100:00100000:0.0:1787384440.717962:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:5568:x1874208173873536:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384440.718099:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:5568:x1874208173873536:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 136us (548us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.718107:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 261 00000100:00100000:3.0:1787384440.718351:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343068380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927168:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384440.718401:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384440.718446:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384440.718478:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731300 going to sleep for 11 seconds 00000100:00100000:0.0:1787384440.719130:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195927296 00000100:00100000:0.0:1787384440.719247:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195927296 00000100:00100000:0.0:1787384440.719276:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787384440.719283:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195927296:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384440.719468:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195927296:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 184us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.719476:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1787384440.719727:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927296:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787384440.720932:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11525:1874208195927424:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384440.721269:0:11525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384440.722074:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195927424 00000100:00100000:0.0:1787384440.722083:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195927424 00000100:00100000:0.0:1787384440.722228:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787384440.722238:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:11525:x1874208195927424:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384440.722452:0:11525:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384440.722852:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351eb0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:11525:x1874208195927424:12345-0@lo:502:llog_process_th.0 Request processed in 614us (1581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.722886:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1787384440.723092:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11525:1874208195927424:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787384440.723123:0:11525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384440.723149:0:11525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384440.723152:0:11525:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787384440.723160:0:11525:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e349e43000 00000020:00000080:3.0:1787384440.723162:0:11525:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787384440.723242:0:11525:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11525:1874208195927552:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787384440.723281:0:11525:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384440.723311:0:11525:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384440.723543:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195927552 00000100:00100000:1.0:1787384440.723549:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195927552 00000100:00100000:1.0:1787384440.723601:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1787384440.723610:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:11525:x1874208195927552:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384440.723778:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:11525:x1874208195927552:12345-0@lo:502:llog_process_th.0 Request processed in 169us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384440.723785:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1787384440.724447:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384440.724505:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173873664 00000100:00100000:1.0:1787384440.724511:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173873664 00000100:00100000:1.0:1787384440.724580:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 265 00000100:00100000:1.0:1787384440.724589:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:5568:x1874208173873664:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384440.724723:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:5568:x1874208173873664:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 135us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384440.724730:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 265 00000100:00100000:2.0:1787384440.724798:0:11525:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11525:1874208195927552:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384440.724825:0:11525:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384440.724831:0:11525:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384440.724833:0:11525:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787384440.724837:0:11525:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787384440.724910:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787384440.724929:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384440.724940:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.724951:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384440.724961:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787384440.724963:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e3450ec800 from 7 10000000:01000000:2.0:1787384440.724967:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384440.725080:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.725089:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.725098:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384440.725115:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927680:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.725157:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384440.725181:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffe000 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.725193:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195927680 00000100:00100000:2.0:1787384440.725196:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195927680 00000100:00100000:2.0:1787384440.725214:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787384440.725220:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:5780:x1874208195927680:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384440.725227:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384440.725238:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e366121600/0x3522fbed3b6c35cc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c35c5 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.725258:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e366121600/0x3522fbed3b6c35cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c35c5 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.725268:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e366121600/0x3522fbed3b6c35cc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c35c5 expref: 18 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.725276:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121600, rc 0) 00000100:00100000:2.0:1787384440.725304:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195927680:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 84us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.725310:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787384440.725358:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927680:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384440.725370:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.725379:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384440.725419:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.725442:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384440.725455:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffe000 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.725465:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195927808 00000100:00100000:2.0:1787384440.725468:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195927808 00000100:00100000:2.0:1787384440.725483:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787384440.725489:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195927808:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.725691:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195927808:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 200us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.725698:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1787384440.725726:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927808:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.725748:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.725782:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384440.725795:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e379ffe000 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.725805:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195927936 00000100:00100000:2.0:1787384440.725808:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195927936 00000100:00100000:2.0:1787384440.725823:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787384440.725828:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195927936:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.725958:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195927936:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 128us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.725969:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1787384440.726087:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195927936:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.726271:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11527:1874208195928064:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384440.726303:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384440.726319:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195928064 00000100:00100000:2.0:1787384440.726323:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195928064 00000100:00100000:2.0:1787384440.726339:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787384440.726344:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:11527:x1874208195928064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384440.726458:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:11527:x1874208195928064:12345-0@lo:502:llog_process_th.0 Request processed in 113us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.726465:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1787384440.726496:0:11527:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e35030e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.726510:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11527:1874208195928064:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384440.726529:0:11527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384440.726539:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384440.726542:0:11527:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787384440.726547:0:11527:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e3450ec800 00000020:00000080:2.0:1787384440.726549:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787384440.726625:0:11527:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11527:1874208195928192:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384440.726658:0:11527:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384440.726675:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195928192 00000100:00100000:2.0:1787384440.726679:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195928192 00000100:00100000:2.0:1787384440.726695:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787384440.726700:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:11527:x1874208195928192:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384440.726799:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:11527:x1874208195928192:12345-0@lo:502:llog_process_th.0 Request processed in 98us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.726812:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:2.0:1787384440.726838:0:11527:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3441b1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.726849:0:11527:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11527:1874208195928192:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384440.726888:0:11527:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384440.726893:0:11527:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384440.726894:0:11527:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787384440.726898:0:11527:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787384440.726938:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787384440.726951:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384440.726957:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.726967:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384440.726987:0:5780:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787384440.726990:0:5780:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e348611800 from 7 10000000:01000000:2.0:1787384440.726992:0:5780:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384440.727011:0:5780:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.727018:0:5780:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.727025:0:5780:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384440.727037:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195928320:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.727061:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384440.727082:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3441b1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.727093:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195928320 00000100:00100000:2.0:1787384440.727097:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195928320 00000100:00100000:2.0:1787384440.727114:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787384440.727120:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:5780:x1874208195928320:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384440.727126:0:5778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384440.727136:0:5778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e366120a00/0x3522fbed3b6c35da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c35d3 expref: -99 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.727153:0:5778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e366120a00/0x3522fbed3b6c35da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c35d3 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.727161:0:5778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e366120a00/0x3522fbed3b6c35da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c35d3 expref: 19 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.727169:0:5778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120a00, rc 0) 00000100:00100000:2.0:1787384440.727194:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195928320:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (131us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.727200:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1787384440.727225:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195928320:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384440.727235:0:5780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.727242:0:5780:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384440.727275:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195928448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.727297:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384440.727316:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3441b1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.727326:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195928448 00000100:00100000:2.0:1787384440.727329:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195928448 00000100:00100000:2.0:1787384440.727341:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787384440.727347:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195928448:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.727505:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195928448:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 157us (205us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.727511:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1787384440.727538:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195928448:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.727559:0:5780:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195928576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.727591:0:5780:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384440.727603:0:5780:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3441b1cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.727837:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195928576 00000100:00100000:2.0:1787384440.727841:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195928576 00000100:00100000:2.0:1787384440.727878:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787384440.727885:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195928576:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.728068:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:5780:x1874208195928576:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.728076:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1787384440.728111:0:5780:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:5780:1874208195928576:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384440.728307:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11528:1874208195928704:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384440.728353:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384440.728370:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195928704 00000100:00100000:2.0:1787384440.728374:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195928704 00000100:00100000:2.0:1787384440.728391:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787384440.728396:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:11528:x1874208195928704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384440.728513:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:11528:x1874208195928704:12345-0@lo:502:llog_process_th.0 Request processed in 115us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.728519:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1787384440.728552:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3779cdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.728564:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11528:1874208195928704:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384440.728582:0:11528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384440.728589:0:11528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384440.728592:0:11528:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787384440.728598:0:11528:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e348611800 00000020:00000080:2.0:1787384440.728601:0:11528:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787384440.728677:0:11528:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11528:1874208195928832:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384440.728708:0:11528:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384440.728726:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195928832 00000100:00100000:2.0:1787384440.728729:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195928832 00000100:00100000:2.0:1787384440.728747:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787384440.728752:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:11528:x1874208195928832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384440.728846:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:11528:x1874208195928832:12345-0@lo:502:llog_process_th.0 Request processed in 92us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384440.728852:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1787384440.728896:0:11528:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3779cdcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384440.728907:0:11528:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eec380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:11528:1874208195928832:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384440.728924:0:11528:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384440.728928:0:11528:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384440.728929:0:11528:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787384440.728933:0:11528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1787384440.728973:0:5780:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1787384440.729007:0:5780:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384440.729014:0:5780:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384440.729022:0:5780:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384440.739160:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384440.739559:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173873792 00000100:00100000:0.0:1787384440.739569:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173873792 00000100:00100000:0.0:1787384440.739631:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 276 00000100:00100000:0.0:1787384440.739641:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:9927:x1874208173873792:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384440.739886:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:9927:x1874208173873792:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 244us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.739894:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 276 00000100:00100000:1.0:1787384440.753666:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384440.754907:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173873920 00000100:00100000:0.0:1787384440.754919:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173873920 00000100:00100000:0.0:1787384440.755027:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 277 00000100:00100000:0.0:1787384440.755038:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:9927:x1874208173873920:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384440.755280:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:9927:x1874208173873920:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 243us (1622us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384440.755298:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 277 00000040:00080000:1.0:1787384440.761584:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787384440.841400:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384441.802018:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787384441.866929:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384442.532124:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384442.532160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384442.532195:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384442.532226:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384442.532415:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173874048 00000100:00100000:3.0:1787384442.532424:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173874048 00000100:00100000:3.0:1787384442.532483:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 278 00000100:00100000:3.0:1787384442.532493:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173874048:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384442.532556:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173874048:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 65us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384442.532564:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 278 00000100:00100000:0.0:1787384442.532663:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173874176 00000100:00100000:0.0:1787384442.532668:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173874176 00000100:00100000:0.0:1787384442.532717:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173874432 00000100:00100000:0.0:1787384442.532721:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173874432 00000100:00100000:2.0:1787384442.532733:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173874304 00000100:00100000:2.0:1787384442.532739:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173874304 00000100:00100000:0.0:1787384442.532748:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 109 00000100:00100000:0.0:1787384442.532757:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173874176:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384442.532780:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:2.0:1787384442.532790:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173874304:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384442.532797:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343069c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173874176:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 40us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384442.532806:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 109 00000100:00100000:0.0:1787384442.532824:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 110 00000100:00100000:2.0:1787384442.532829:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173874304:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 38us (665us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384442.532836:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173874432:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384442.532843:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:0.0:1787384442.532922:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173874432:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 89us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384442.532929:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 110 00000100:00080000:3.0:1787384442.533357:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787384442.533362:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787384442.892909:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384443.913112:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787384444.036422:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:3.0:1787384444.489354:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384444.489381:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37bbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195928960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384444.489448:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384444.489987:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195928960 00000100:00100000:0.0:1787384444.489996:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195928960 00000100:00100000:0.0:1787384444.490071:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384444.490081:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195928960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384444.490121:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384444.490174:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195928960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384444.490182:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:3.0:1787384444.490349:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787384444.490384:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37bbdb800 x1874208195928960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384460 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384444.490417:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37bbdb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195928960:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384444.938621:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384445.001321:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384445.001483:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384445.001502:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195929216:0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.001564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384445.001817:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195929216 00000100:00100000:1.0:1787384445.001826:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195929216 00000100:00100000:1.0:1787384445.001896:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787384445.001916:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195929216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384445.001970:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195929216:12345-0@lo:400:kworker.0 Request processed in 65us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384445.001977:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787384445.003068:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195929216:0@lo:400:kworker.0 00000100:00100000:0.0:1787384445.004694:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195929088:0@lo:400:kworker.0 00000100:00100000:0.0:1787384445.004781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384445.005287:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195929088 00000100:00100000:1.0:1787384445.005297:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195929088 00000100:00100000:1.0:1787384445.005368:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787384445.005392:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195929088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384445.005645:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195929088:12345-0@lo:400:kworker.0 Request processed in 255us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384445.005653:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:0.0:1787384445.005758:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195929088:0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.006256:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195929472:0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.006298:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384445.006323:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384445.006329:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195929344:0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.006366:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384445.006395:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195929344 00000100:00100000:2.0:1787384445.006400:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195929344 00000100:00100000:2.0:1787384445.006438:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787384445.006457:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195929344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.006511:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195929344:12345-0@lo:400:kworker.0 Request processed in 65us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384445.006518:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787384445.006552:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195929344:0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.006578:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195929600:0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.006613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384445.006632:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384445.006637:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195929728:0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.006656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384445.006679:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195929600 00000100:00100000:2.0:1787384445.006682:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195929600 00000100:00100000:2.0:1787384445.006709:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787384445.006716:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195929600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.006754:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195929600:12345-0@lo:400:kworker.0 Request processed in 38us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384445.006772:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787384445.006811:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195929600:0@lo:400:kworker.0 00000100:00100000:3.0:1787384445.007391:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195929472 00000100:00100000:3.0:1787384445.007398:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195929472 00000100:00100000:3.0:1787384445.007434:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195929728 00000100:00100000:3.0:1787384445.007437:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195929728 00000100:00100000:3.0:1787384445.007550:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787384445.007558:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195929472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384445.007622:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195929472:12345-0@lo:400:kworker.0 Request processed in 65us (1322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384445.007629:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787384445.007641:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787384445.007647:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195929728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384445.007672:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195929728:12345-0@lo:400:kworker.0 Request processed in 26us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384445.007677:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1787384445.007696:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787384445.007700:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787384445.007722:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2bc380 x1874208195929472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384461 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384445.007734:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195929472:0@lo:400:kworker.0 00000100:00100000:2.0:1787384445.008239:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1787384445.008246:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e343069500, transno 4294967300 00000100:00100000:2.0:1787384445.008261:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195929728:0@lo:400:kworker.0 00000100:00100000:3.0:1787384445.513233:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384445.513273:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195929856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384445.513498:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384445.513752:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195929856 00000100:00100000:0.0:1787384445.513760:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195929856 00000100:00100000:0.0:1787384445.513852:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1787384445.513892:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195929856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384445.513935:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384445.513990:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195929856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384445.513998:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787384445.514048:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195929856:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384445.961957:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384446.985150:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384447.649619:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384447.649663:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384447.649718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384447.649763:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384447.649903:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173874560 00000100:00100000:3.0:1787384447.649913:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173874560 00000100:00100000:3.0:1787384447.649975:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 280 00000100:00100000:3.0:1787384447.649986:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2350:x1874208173874560:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384447.650071:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2350:x1874208173874560:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 75us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384447.650079:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 280 00000100:00100000:3.0:1787384447.650238:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173874816 00000100:00100000:3.0:1787384447.650244:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173874816 00000100:00100000:3.0:1787384447.650286:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:3.0:1787384447.650292:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173874816:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384447.650326:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbdb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173874816:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 35us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384447.650333:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00080000:3.0:1787384447.650371:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384447.650755:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173874688 00000100:00100000:1.0:1787384447.650761:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173874688 00000100:00100000:1.0:1787384447.650796:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173874944 00000100:00100000:1.0:1787384447.650799:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173874944 00000100:00100000:1.0:1787384447.650821:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:1.0:1787384447.650828:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173874688:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384447.650889:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173874688:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 61us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384447.650896:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:1.0:1787384447.650913:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:1.0:1787384447.650920:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2350:x1874208173874944:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384447.650946:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbdb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2350:x1874208173874944:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384447.650953:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00080000:3.0:1787384447.652782:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787384448.009013:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384449.033316:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384449.609198:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195929984:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384449.609304:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384449.617646:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195929984 00000100:00100000:3.0:1787384449.617669:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195929984 00000100:00100000:3.0:1787384449.617781:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787384449.617794:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195929984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384449.617847:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787384449.618022:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384449.618252:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195929984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 460us (8947us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384449.618261:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1787384449.618380:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2bf800 x1874208195929984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384465 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384449.618407:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195929984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787384450.058423:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384450.121214:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195930496:0@lo:400:kworker.0 00000100:00100000:1.0:1787384450.121320:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384450.121386:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384450.121393:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e34306aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195930368:0@lo:400:kworker.0 00000100:00100000:1.0:1787384450.121422:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384450.121455:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195930368 00000100:00100000:1.0:1787384450.121463:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195930368 00000100:00100000:3.0:1787384450.121770:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195930496 00000100:00100000:3.0:1787384450.121775:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195930496 00000100:00100000:3.0:1787384450.121819:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787384450.121829:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195930496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384450.121909:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195930496:12345-0@lo:400:kworker.0 Request processed in 81us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384450.121916:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787384450.121972:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e343068700 x1874208195930496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384466 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384450.121987:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195930496:0@lo:400:kworker.0 00000100:00100000:1.0:1787384450.122163:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1787384450.122174:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195930368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384450.122212:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195930368:12345-0@lo:400:kworker.0 Request processed in 42us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384450.122218:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1787384450.122327:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195930112:0@lo:400:kworker.0 00000100:00100000:2.0:1787384450.122364:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384450.122391:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195930624:0@lo:400:kworker.0 00000100:00100000:2.0:1787384450.122414:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384450.122445:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787384450.122451:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e34306a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195930240:0@lo:400:kworker.0 00000100:00100000:2.0:1787384450.122474:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384450.122502:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195930752:0@lo:400:kworker.0 00000100:00100000:1.0:1787384450.122654:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195930624 00000100:00100000:1.0:1787384450.122660:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195930624 00000100:00100000:1.0:1787384450.122680:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195930240 00000100:00100000:1.0:1787384450.122683:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195930240 00000100:00100000:1.0:1787384450.122697:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787384450.122703:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195930624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384450.122736:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195930624:12345-0@lo:400:kworker.0 Request processed in 33us (320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384450.122742:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1787384450.122754:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1787384450.122761:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195930240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384450.122785:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195930240:12345-0@lo:400:kworker.0 Request processed in 26us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384450.122790:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1787384450.122806:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384450.122834:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195930112 00000100:00100000:1.0:1787384450.122844:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195930112 00000100:00100000:1.0:1787384450.122890:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787384450.122898:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195930112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384450.122929:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195930112:12345-0@lo:400:kworker.0 Request processed in 33us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384450.122935:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787384450.123129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384450.123157:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195930112:0@lo:400:kworker.0 00000100:00100000:2.0:1787384450.123168:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195930624:0@lo:400:kworker.0 00000100:00100000:2.0:1787384450.123191:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e34306a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195930240:0@lo:400:kworker.0 00000100:00100000:3.0:1787384450.123317:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195930752 00000100:00100000:3.0:1787384450.123323:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195930752 00000100:00100000:3.0:1787384450.123366:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787384450.123373:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195930752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384450.123408:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195930752:12345-0@lo:400:kworker.0 Request processed in 37us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384450.123414:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787384450.123445:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e34306aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195930368:0@lo:400:kworker.0 00000100:00080000:2.0:1787384450.123721:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384450.123744:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343069880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195930752:0@lo:400:kworker.0 00000100:00100000:3.0:1787384450.633325:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195930880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384450.633405:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384450.634249:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195930880 00000100:00100000:2.0:1787384450.634264:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195930880 00000100:00100000:2.0:1787384450.634328:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787384450.634339:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195930880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384450.634380:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384450.634455:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195930880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 119us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384450.634463:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787384450.634582:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195930880:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787384451.017437:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787384451.083097:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384452.105107:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384452.767951:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384452.767998:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384452.768048:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173875072 00000100:00100000:0.0:1787384452.768057:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173875072 00000100:00100000:0.0:1787384452.768116:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 282 00000100:00100000:0.0:1787384452.768125:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173875072:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384452.768191:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173875072:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 68us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384452.768199:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 282 00000100:00100000:1.0:1787384452.775434:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173875200 00000100:00100000:1.0:1787384452.775450:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173875200 00000100:00100000:1.0:1787384452.775561:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:1.0:1787384452.775578:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173875200:12345-192.168.203.51@tcp:400:kworker.0 00000100:00080000:2.0:1787384452.775609:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384452.775805:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173875200:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 234us (7805us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384452.775813:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:3.0:1787384452.804502:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384452.804561:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384452.804664:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173875456 00000100:00100000:2.0:1787384452.804673:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173875456 00000100:00100000:2.0:1787384452.804753:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:2.0:1787384452.804763:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173875456:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384452.804837:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173875456:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 75us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384452.804894:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:0.0:1787384452.805509:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173875328 00000100:00100000:0.0:1787384452.805515:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173875328 00000100:00100000:0.0:1787384452.805567:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:0.0:1787384452.805576:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2349:x1874208173875328:12345-192.168.203.51@tcp:9:kworker.0 00000020:00000080:0.0:1787384452.805598:0:6574:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3516 00000100:00080000:0.0:1787384452.805607:0:6574:0:(import.c:65:import_set_state_nolock()) ffff89e37b8f7000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787384452.805649:0:6574:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:3.0:1787384452.805935:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384452.806214:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+2:2349:x1874208173875328:12345-192.168.203.51@tcp:9:kworker.0 Request processed in 637us (1719us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384452.806222:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00080000:1.0:1787384452.806318:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384452.806324:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787384453.129434:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384454.155359:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787384454.271706:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:0.0:1787384454.271725:0:7483:0:(genops.c:906:class_export_put()) final put ffff89e373380800/ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:1.0:1787384454.271993:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff89e373380800/ddc9253f-47aa-4509-981d-645f91ec7250 for lustre-OST0001 00000020:00000080:1.0:1787384454.272061:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e37b8f7000 for lustre-OST0001 00000100:00100000:1.0:1787384454.729351:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384454.729373:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195931008:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384454.729441:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384454.729634:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195931008 00000100:00100000:2.0:1787384454.729641:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195931008 00000100:00080000:1.0:1787384454.729750:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384454.729834:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787384454.729845:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195931008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384454.729903:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384454.729952:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195931008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384454.729960:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:1.0:1787384454.730026:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37b2bea00 x1874208195931008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384470 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384454.730044:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195931008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787384455.177024:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384455.241217:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195931520:0@lo:400:kworker.0 00000100:00100000:2.0:1787384455.241285:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384455.241345:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384455.241350:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195931392:0@lo:400:kworker.0 00000100:00100000:2.0:1787384455.241375:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.241500:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195931264:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.241544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.241561:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195931776:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.241582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.241600:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787384455.241606:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195931136:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.241631:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.241665:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195931648:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.241687:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.241726:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195931520 00000100:00100000:3.0:1787384455.241733:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195931520 00000100:00100000:3.0:1787384455.241772:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195931776 00000100:00100000:3.0:1787384455.241775:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195931776 00000100:00100000:3.0:1787384455.241805:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787384455.241814:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195931520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.241905:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195931520:12345-0@lo:400:kworker.0 Request processed in 92us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.241913:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787384455.241933:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787384455.241938:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195931776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.241967:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195931776:12345-0@lo:400:kworker.0 Request processed in 29us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.241972:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787384455.241990:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195931136 00000100:00100000:3.0:1787384455.241993:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195931136 00000100:00100000:3.0:1787384455.242010:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787384455.242028:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195931136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.242053:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195931136:12345-0@lo:400:kworker.0 Request processed in 25us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.242058:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787384455.242082:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195931392 00000100:00100000:3.0:1787384455.242085:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195931392 00000100:00100000:3.0:1787384455.242106:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195931264 00000100:00100000:3.0:1787384455.242108:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195931264 00000100:00100000:3.0:1787384455.242116:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195931648 00000100:00100000:3.0:1787384455.242118:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195931648 00000100:00100000:3.0:1787384455.242132:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787384455.242137:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195931392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.242161:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195931392:12345-0@lo:400:kworker.0 Request processed in 24us (785us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.242166:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1787384455.242174:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787384455.242179:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195931264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.242196:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195931264:12345-0@lo:400:kworker.0 Request processed in 17us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.242201:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787384455.242209:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1787384455.242213:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195931648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.242230:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343069880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195931648:12345-0@lo:400:kworker.0 Request processed in 17us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.242235:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:3.0:1787384455.242251:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384455.242255:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384455.242294:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195931136:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.242304:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195931648:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.242312:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195931264:0@lo:400:kworker.0 00000100:00100000:3.0:1787384455.242319:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195931776:0@lo:400:kworker.0 00000100:00100000:2.0:1787384455.243181:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195931392:0@lo:400:kworker.0 00010000:00080000:2.0:1787384455.243196:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e372f1c380 x1874208195931520/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384471 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384455.243207:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195931520:0@lo:400:kworker.0 00000100:00100000:1.0:1787384455.753650:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195931904:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384455.753721:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384455.753886:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195931904 00000100:00100000:3.0:1787384455.753893:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195931904 00000100:00100000:3.0:1787384455.753942:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787384455.753951:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195931904:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384455.753997:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384455.754052:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195931904:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384455.754059:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787384455.754248:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195931904:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384456.202795:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384457.225161:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384457.887562:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384457.887611:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384457.887650:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384457.887742:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173875840 00000100:00100000:1.0:1787384457.887751:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173875840 00000100:00100000:1.0:1787384457.887814:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173875712 00000100:00100000:1.0:1787384457.887817:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173875712 00000100:00100000:1.0:1787384457.887888:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:1.0:1787384457.887898:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173875840:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384457.887972:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173875840:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 75us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384457.887981:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:1.0:1787384457.888002:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:1.0:1787384457.888008:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2352:x1874208173875712:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384457.888033:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2352:x1874208173875712:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 25us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384457.888039:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00080000:3.0:1787384457.888256:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384457.890261:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173875584 00000100:00100000:2.0:1787384457.890278:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173875584 00000100:00100000:2.0:1787384457.890351:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 284 00000100:00100000:2.0:1787384457.890363:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173875584:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384457.890435:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173875584:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 74us (2883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384457.890459:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 284 00010000:00010000:1.0:1787384458.249231:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384459.272978:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384459.849313:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384459.849409:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195932032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384459.849477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384459.849601:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195932032 00000100:00100000:3.0:1787384459.849610:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195932032 00000100:00100000:3.0:1787384459.849675:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787384459.849685:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195932032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384459.849722:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384459.849776:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195932032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384459.849783:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1787384459.849839:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e343069180 x1874208195932032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384475 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384459.849883:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195932032:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787384459.849957:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787384460.297252:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384460.369685:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195932288:0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.369762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384460.369813:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195932800:0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.369838:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384460.369885:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787384460.369892:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195932160:0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.369923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384460.369951:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195932672:0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.369991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384460.370015:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195932416:0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.370039:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384460.370056:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384460.370061:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195932544:0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.370131:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195932288 00000100:00100000:1.0:1787384460.370141:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195932288 00000100:00100000:1.0:1787384460.370194:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195932672 00000100:00100000:1.0:1787384460.370198:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195932672 00000100:00100000:1.0:1787384460.370233:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195932416 00000100:00100000:1.0:1787384460.370236:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195932416 00000100:00100000:1.0:1787384460.370257:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787384460.370267:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195932288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.370325:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195932288:12345-0@lo:400:kworker.0 Request processed in 60us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384460.370332:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1787384460.370352:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787384460.370359:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195932672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.370384:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241333800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195932672:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384460.370390:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1787384460.370400:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1787384460.370406:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195932416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.370431:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195932416:12345-0@lo:400:kworker.0 Request processed in 25us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384460.370436:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:1.0:1787384460.370456:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384460.370495:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195932672:0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.370508:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343069500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195932288:0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.370522:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384460.370554:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343068700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195932416:0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.370580:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195932800 00000100:00100000:3.0:1787384460.370583:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195932800 00000100:00100000:3.0:1787384460.370620:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195932544 00000100:00100000:3.0:1787384460.370622:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195932544 00000100:00100000:3.0:1787384460.370638:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787384460.370643:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195932800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.370684:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195932800:12345-0@lo:400:kworker.0 Request processed in 41us (845us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384460.370690:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787384460.370702:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1787384460.370708:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195932544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384460.370733:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195932544:12345-0@lo:400:kworker.0 Request processed in 25us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384460.370738:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:3.0:1787384460.370768:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e241332300 x1874208195932544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787384476 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384460.370778:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195932544:0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.371234:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195932160 00000100:00100000:2.0:1787384460.371240:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195932160 00000100:00100000:2.0:1787384460.371269:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:2.0:1787384460.371275:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195932160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384460.371310:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195932160:12345-0@lo:400:kworker.0 Request processed in 36us (1387us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384460.371316:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00080000:1.0:1787384460.371397:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384460.371418:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343069180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195932160:0@lo:400:kworker.0 00000100:00100000:1.0:1787384460.371429:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195932800:0@lo:400:kworker.0 00000100:00100000:0.0:1787384460.873187:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787384460.873219:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195932928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384460.873290:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384460.873414:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195932928 00000100:00100000:1.0:1787384460.873423:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195932928 00000100:00100000:1.0:1787384460.873502:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787384460.873512:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195932928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384460.873549:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384460.873603:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195932928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384460.873609:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787384460.873793:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195932928:0@lo:13:osp-pre-1-0.0 00000040:00080000:1.0:1787384461.257677:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787384461.321835:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384462.345352:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384463.024610:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384463.024676:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384463.024718:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384463.024955:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173875968 00000100:00100000:1.0:1787384463.024966:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173875968 00000100:00100000:2.0:1787384463.025092:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173876224 00000100:00100000:2.0:1787384463.025097:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173876224 00000100:00100000:2.0:1787384463.025166:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173876096 00000100:00100000:2.0:1787384463.025170:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173876096 00000100:00100000:2.0:1787384463.025202:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 129 00000100:00100000:2.0:1787384463.025211:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173876224:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384463.025299:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173876224:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 88us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384463.025308:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 129 00000100:00100000:2.0:1787384463.025336:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00100000:2.0:1787384463.025343:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173876096:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384463.025372:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173876096:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 30us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384463.025378:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00100000:1.0:1787384463.031168:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 286 00000100:00100000:1.0:1787384463.031200:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173875968:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384463.031275:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173875968:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 84us (6674us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384463.031283:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 286 00000100:00080000:2.0:1787384463.033710:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:1.0:1787384463.120431:0:11694:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 03:41:00 (1787384460) 00010000:00010000:3.0:1787384463.376854:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384464.394150:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384464.862261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384464.862352:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173876352 00000100:00100000:1.0:1787384464.862370:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173876352 00000100:00100000:1.0:1787384464.862434:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:1.0:1787384464.862445:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:10197:x1874208173876352:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384464.862624:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384464.862652:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c35e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d0c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384464.862722:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c35e8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384464.862751:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c35e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384464.862763:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c35e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384464.863109:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787384464.863114:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787384464.863217:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c35e8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384464.863244:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c35e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d0c expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384464.863260:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c35e8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d0c expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384464.863268:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e346919900) 00010000:00010000:1.0:1787384464.863272:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384464.863275:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624ce00, rc 0) 00000100:00100000:1.0:1787384464.863378:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:10197:x1874208173876352:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 934us (1128us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384464.863387:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:2.0:1787384464.886442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384464.886559:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173876480 00000100:00100000:3.0:1787384464.886569:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173876480 00000100:00100000:3.0:1787384464.886625:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:3.0:1787384464.886635:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:10198:x1874208173876480:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384464.886657:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384464.886680:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c35ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d13 expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384464.886747:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c35f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384464.886760:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c35f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384464.886780:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c35f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384464.886796:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c35fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384464.886803:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c35fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384464.886810:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c35fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384464.887738:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fc000/0x3522fbed3b6c3604 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384464.887757:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fc000/0x3522fbed3b6c3604 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384464.887765:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fc000/0x3522fbed3b6c3604 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384464.888692:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787384464.888699:0:7691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384464.888843:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fc000/0x3522fbed3b6c3604 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.888878:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c35f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.888886:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c35f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.888893:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c35f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.888900:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384464.888904:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c35f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.888912:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c35f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.888927:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e346919900) 00010000:00010000:2.0:1787384464.888931:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384464.888935:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c35f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.888941:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c35f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.888954:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c35fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.888961:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c35fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.888974:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c35fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.889045:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fdc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384464.889049:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c35fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.889054:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c35fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.889063:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff89e34836ae00) 00010000:00010000:2.0:1787384464.889065:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384464.889068:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c35fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.889074:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c35fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.889116:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c35ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d13 expref: 8 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.889131:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fc000/0x3522fbed3b6c3604 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d13 expref: 7 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.889139:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e34836a700) 00010000:00010000:2.0:1787384464.889141:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384464.889143:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fc000, rc 0) 00000100:00100000:2.0:1787384464.889290:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:10198:x1874208173876480:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 2655us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384464.889309:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:1.0:1787384464.899106:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384464.899263:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173876736 00000100:00100000:2.0:1787384464.899273:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173876736 00000100:00100000:2.0:1787384464.899374:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:2.0:1787384464.899385:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:10198:x1874208173876736:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384464.899410:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384464.899432:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c360b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d1a expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.899535:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3612 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.899550:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3612 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.899561:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3612 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.899629:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3619 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.899636:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3619 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.899643:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3619 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.902348:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c3620 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.903494:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c3620 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.903507:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c3620 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384464.903528:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787384464.903812:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3612 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.903820:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3612 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.903826:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3612 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.903832:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121e00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384464.903837:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3612 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.903844:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3612 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.905459:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e34836a700) 00010000:00010000:2.0:1787384464.905470:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384464.905480:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3612 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.905488:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3612 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.905774:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3619 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.905801:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3619 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.905808:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3619 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.905814:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384464.905818:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3619 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.905826:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3619 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.905841:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89e345695900) 00010000:00010000:2.0:1787384464.905843:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384464.905846:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3619 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.905851:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3619 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.907312:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c360b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d1a expref: 10 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.907344:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c3620 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d1a expref: 9 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384464.907361:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:2.0:1787384464.907364:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384464.907379:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121200, rc 0) 00000100:00100000:2.0:1787384464.907482:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+9:10198:x1874208173876736:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 8096us (8383us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787384464.907492:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:0.0:1787384464.913564:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384464.913769:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173876864 00000100:00100000:2.0:1787384464.913779:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173876864 00000100:00100000:2.0:1787384464.913847:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:2.0:1787384464.913857:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:10198:x1874208173876864:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787384464.914004:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:10198:x1874208173876864:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 148us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384464.914011:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:0.0:1787384464.969535:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195933056:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384464.969614:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384464.969799:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195933056 00000100:00100000:1.0:1787384464.969807:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195933056 00000100:00100000:1.0:1787384464.969882:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787384464.969893:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195933056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384464.969937:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384464.969987:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195933056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384464.969994:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787384464.970033:0:3307:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37275dc00 x1874208195933056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384480 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384464.970050:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195933056:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787384464.971068:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1787384465.355055:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787384465.417025:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384465.482056:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195933440:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.482069:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195933312:0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.482157:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195933184:0@lo:400:kworker.0 00000100:00100000:1.0:1787384465.485595:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195933568:0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.486686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.486776:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195933312 00000100:00100000:3.0:1787384465.486784:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195933312 00000100:00100000:3.0:1787384465.486832:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1787384465.486841:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195933312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384465.486913:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195933312:12345-0@lo:400:kworker.0 Request processed in 73us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384465.486935:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1787384465.488177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384465.488210:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195933184 00000100:00100000:0.0:1787384465.488215:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195933184 00000100:00100000:0.0:1787384465.488252:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787384465.488261:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195933184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.488303:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e68450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195933184:12345-0@lo:400:kworker.0 Request processed in 44us (130us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384465.488309:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1787384465.488366:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195933184:0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.488378:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195933696:0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.488407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384465.488527:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384465.488621:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195933696 00000100:00100000:2.0:1787384465.488626:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195933696 00000100:00100000:2.0:1787384465.488676:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787384465.488684:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195933696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384465.488722:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195933696:12345-0@lo:400:kworker.0 Request processed in 39us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384465.488728:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787384465.488978:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195933440 00000100:00100000:0.0:1787384465.488982:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195933440 00000100:00100000:0.0:1787384465.489205:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1787384465.489225:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195933440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.489268:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195933440:12345-0@lo:400:kworker.0 Request processed in 44us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384465.489274:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787384465.489802:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384465.489951:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195933312:0@lo:400:kworker.0 00000100:00100000:2.0:1787384465.497730:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195933568 00000100:00100000:2.0:1787384465.497746:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195933568 00000100:00100000:2.0:1787384465.498270:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1787384465.498285:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195933568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384465.498375:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343069180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195933568:12345-0@lo:400:kworker.0 Request processed in 95us (8574us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384465.498396:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1787384465.500143:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384465.500155:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384465.500207:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195933696:0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.500249:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195933440:0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.500293:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195933568:0@lo:400:kworker.0 00000100:00100000:0.0:1787384465.996782:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195933824:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384465.996845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384465.996981:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195933824 00000100:00100000:2.0:1787384465.996989:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195933824 00000100:00100000:2.0:1787384465.997040:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787384465.997050:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195933824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384465.997082:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384465.997125:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195933824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (280us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384465.997132:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787384465.997171:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195933824:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787384466.441084:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384467.281970:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384467.282074:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173876992 00000100:00100000:3.0:1787384467.282084:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173876992 00000100:00080000:1.0:1787384467.282304:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384467.282613:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:3.0:1787384467.282626:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:10240:x1874208173876992:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384467.282647:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384467.282666:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c362e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d21 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.282730:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3635 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.282745:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.282759:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.282775:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c363c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.282781:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c363c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.282788:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c363c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283078:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3635 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283094:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3635 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283221:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283228:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384467.283233:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3635 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283240:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3635 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283253:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e346919900) 00010000:00010000:3.0:1787384467.283256:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384467.283261:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3635 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283268:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3635 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283280:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c363c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283286:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c363c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283291:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c363c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283296:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fce00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384467.283306:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c363c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283312:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c363c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283320:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89e34836ab00) 00010000:00010000:3.0:1787384467.283323:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384467.283326:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c363c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283332:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c363c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283370:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c362e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d21 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283380:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e346919900) 00010000:00010000:3.0:1787384467.283383:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384467.283387:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c362e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d21 expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.283396:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd600, rc 0) 00000100:00100000:3.0:1787384467.283517:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:10240:x1874208173876992:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 894us (1557us total) trans 0 rc 301/301 00000100:00100000:3.0:1787384467.283532:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:1.0:1787384467.299302:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384467.299377:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173877248 00000100:00100000:3.0:1787384467.299387:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173877248 00000100:00100000:3.0:1787384467.299451:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:3.0:1787384467.299462:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+9:10240:x1874208173877248:12345-192.168.203.51@tcp:36:lfs.0 00010000:00010000:3.0:1787384467.299529:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384467.299555:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c35e8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d0c expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.299572:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e346919900) 00010000:00010000:3.0:1787384467.299584:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384467.299849:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3643 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.299899:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3643 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.299911:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3643 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.299923:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.299930:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.299936:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384467.301837:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787384467.301854:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3643 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.301889:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3643 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.301896:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3643 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.301909:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384467.301914:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3643 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.301922:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3643 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.301937:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a900) 00010000:00010000:3.0:1787384467.301940:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384467.301944:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3643 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.301950:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3643 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384467.301970:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086ff580f reply state 0000000060a783f6 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384467.301978:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384467.302095:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343068700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+10:10240:x1874208173877248:12345-192.168.203.51@tcp:36:lfs.0 Request processed in 2630us (2797us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1787384467.303326:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00010000:00010000:3.0:1787384467.307027:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.307044:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.307052:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.307072:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384467.307077:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.307085:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.307206:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89e34836ab00) 00010000:00010000:3.0:1787384467.307210:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384467.307214:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.307221:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c364a lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384467.423584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.424214:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173877376 00000100:00100000:2.0:1787384467.424224:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173877376 00000100:00100000:3.0:1787384467.424409:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:3.0:1787384467.424425:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+9:10248:x1874208173877376:12345-192.168.203.51@tcp:101:lctl.0 00010000:00010000:3.0:1787384467.424467:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384467.424508:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3651 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d28 expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.424612:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3658 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.424629:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.424645:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384467.424759:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787384467.424763:0:7691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384467.424817:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3658 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.424849:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3651 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d28 expref: 11 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.424909:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3658 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d28 expref: 10 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.424921:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:3.0:1787384467.424925:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384467.424931:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd400, rc 0) 00000100:00100000:3.0:1787384467.425032:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343069500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+10:10248:x1874208173877376:12345-192.168.203.51@tcp:101:lctl.0 Request processed in 610us (1457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384467.425041:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00010000:00010000:3.0:1787384467.465218:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384467.506740:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.507401:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173877504 00000100:00100000:2.0:1787384467.507508:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173877504 00000100:00100000:2.0:1787384467.507624:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:2.0:1787384467.507635:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+10:10254:x1874208173877504:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384467.507656:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384467.507680:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c365f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d2f expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.507756:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3666 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.507771:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.507783:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.507814:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c366d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.507822:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c366d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.507830:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c366d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.507959:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3674 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.507968:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.507975:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384467.508008:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787384467.508012:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384467.508051:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3674 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508064:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3666 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508071:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3666 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508077:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3666 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508094:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384467.508100:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3666 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508108:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3666 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508120:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:2.0:1787384467.508123:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384467.508127:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508133:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508146:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c366d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508150:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c366d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508156:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c366d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508160:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384467.508162:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c366d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508167:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c366d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508183:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff89e345695900) 00010000:00010000:2.0:1787384467.508185:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384467.508188:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c366d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508193:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c366d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508242:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c365f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d2f expref: 12 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508256:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3674 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d2f expref: 11 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.508263:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:2.0:1787384467.508265:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787384467.508267:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121e00, rc 0) 00000100:00100000:2.0:1787384467.508392:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+11:10254:x1874208173877504:12345-192.168.203.51@tcp:101:bash.0 Request processed in 758us (1660us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384467.508401:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:0.0:1787384467.513683:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384467.517315:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173877760 00000100:00100000:3.0:1787384467.517331:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173877760 00000100:00100000:3.0:1787384467.517403:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:3.0:1787384467.517441:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+11:10254:x1874208173877760:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1787384467.517462:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384467.517483:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c367b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d36 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.517621:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3682 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.517651:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3682 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.517664:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3682 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.517728:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.517736:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.517743:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787384467.518392:0:5785:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1787384467.518577:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518589:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518598:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518633:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3682 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518641:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3682 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518647:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3682 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518660:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fce00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384467.518665:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3682 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518672:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3682 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518685:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384467.518688:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384467.518693:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3682 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518700:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3682 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384467.518715:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000536cdf6e reply state 00000000ba466df6 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384467.518724:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787384467.518758:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c367b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d36 expref: 14 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518772:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d36 expref: 13 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.518779:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836a900) 00010000:00010000:3.0:1787384467.518781:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384467.518784:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fdc00, rc 0) 00000100:00100000:3.0:1787384467.518886:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+14:10254:x1874208173877760:12345-192.168.203.51@tcp:101:bash.0 Request processed in 1447us (5185us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1787384467.518902:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00010000:00010000:0.0:1787384467.522988:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.523007:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.523014:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.523020:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384467.523025:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.523034:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.523072:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e34836ab00) 00010000:00010000:0.0:1787384467.523075:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384467.523081:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.523087:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3689 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384467.527698:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384467.527971:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173877888 00000100:00100000:3.0:1787384467.527985:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173877888 00000100:00100000:3.0:1787384467.528040:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:3.0:1787384467.528051:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874208173877888:12345-192.168.203.51@tcp:8:bash.0 00010000:00080000:3.0:1787384467.528095:0:6576:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp t0 exp 0000000000000000 cur 328 last 0 00000020:00000080:3.0:1787384467.528140:0:6576:0:(genops.c:1406:class_connect()) connect: client ddc9253f-47aa-4509-981d-645f91ec7250, cookie 0x3522fbed3b6c369e 00002000:00100000:3.0:1787384467.528157:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ddc9253f-47aa-4509-981d-645f91ec7250/ffff89e3727a9800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787384467.528189:0:6576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787384467.528802:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787384467.528844:0:6576:0:(import.c:65:import_set_state_nolock()) ffff89e3727a8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384467.528980:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2349:x1874208173877888:12345-192.168.203.51@tcp:8:bash.0 Request processed in 929us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384467.528990:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:1.0:1787384467.537079:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.537194:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173878016 00000100:00100000:2.0:1787384467.537211:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173878016 00000100:00080000:1.0:1787384467.537292:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384467.537324:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:2.0:1787384467.537337:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:0:x1874208173878016:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384467.537355:0:6575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384467.537380:0:6575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d0bf22c/0x3522fbed3b6c36a5 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d3d expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384467.537610:0:6575:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384467.537632:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=328s v=(0 0) 00010000:00010000:2.0:1787384467.537637:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384467.537647:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d0bf22c/0x3522fbed3b6c36a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d3d expref: 7 pid: 6575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.537667:0:6575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d0bf22c/0x3522fbed3b6c36a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d3d expref: 7 pid: 6575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.537680:0:6575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120400, rc 0) 00000100:00100000:2.0:1787384467.537757:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:0:x1874208173878016:12345-192.168.203.51@tcp:101:bash.0 Request processed in 424us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384467.537832:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:1.0:1787384467.544941:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384467.545307:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173878144 00000100:00100000:3.0:1787384467.545321:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173878144 00000100:00100000:3.0:1787384467.546136:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:3.0:1787384467.546327:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+7:10254:x1874208173878144:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1787384467.546607:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384467.546637:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d44 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.546683:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d0bf22c/0x3522fbed3b6c36a5 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d3d expref: 8 pid: 6575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.546717:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384467.546723:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384467.546730:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 8 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.546783:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d0bf22c/0x3522fbed3b6c36a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d3d expref: 8 pid: 6575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.547160:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d0bf22c/0x3522fbed3b6c36a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d3d expref: 8 pid: 6575 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384467.547181:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6576:1874208195933952:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384467.547342:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384467.551485:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6576:1874208195933952:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384467.551538:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 8 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.551566:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd600, rc 0) 00000100:00100000:3.0:1787384467.551694:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+8:10254:x1874208173878144:12345-192.168.203.51@tcp:101:bash.0 Request processed in 5546us (6766us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384467.551705:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:1.0:1787384467.552749:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.553299:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173878272 00000100:00100000:2.0:1787384467.553312:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173878272 00010000:00010000:2.0:1787384467.553361:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d0bf22c/0x3522fbed3b6c36a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d3d expref: 8 pid: 6575 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384467.553406:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:2.0:1787384467.553417:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173878272:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384467.553445:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384467.553477:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d0bf22c/0x3522fbed3b6c36a5 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d3d expref: 8 pid: 6575 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.553576:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d0bf22c/0x3522fbed3b6c36a5 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d3d expref: 8 pid: 6575 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.553701:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d0bf22c/0x3522fbed3b6c36a5 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d3d expref: 8 pid: 6575 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.553730:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384467.553735:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384467.553745:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.553756:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.553811:0:5769:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384467.553828:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5769:1874208195934080:192.168.203.51@tcp:105: 00000100:00100000:2.0:1787384467.553966:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3741dd240 going to sleep for 11 seconds 00000100:00100000:2.0:1787384467.555807:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1d180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5769:1874208195934080:192.168.203.51@tcp:105: 00010000:00010000:2.0:1787384467.555842:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384467.555952:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173878272:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 2535us (3208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384467.555974:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:1.0:1787384467.558160:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.558219:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173878528 00000100:00100000:2.0:1787384467.558229:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173878528 00000100:00100000:2.0:1787384467.558291:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:2.0:1787384467.558303:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+13:10254:x1874208173878528:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:2.0:1787384467.560004:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+14:10254:x1874208173878528:12345-192.168.203.51@tcp:35:bash.0 Request processed in 1691us (1848us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787384467.560022:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1787384467.654928:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384467.655297:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173878784 00000100:00100000:0.0:1787384467.655311:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173878784 00000100:00100000:0.0:1787384467.655477:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:0.0:1787384467.655490:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+14:10264:x1874208173878784:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384467.655615:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384467.655645:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c36b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d4b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384467.655817:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787384467.656493:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c36b3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d4b expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.656675:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:0.0:1787384467.656679:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384467.656686:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c36b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d4b expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.656706:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a600, rc 0) 00000100:00100000:0.0:1787384467.656909:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+15:10264:x1874208173878784:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1421us (2050us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787384467.656943:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:1.0:1787384467.662557:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.662670:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173879040 00000100:00100000:2.0:1787384467.662683:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173879040 00000100:00100000:2.0:1787384467.662791:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:2.0:1787384467.662804:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+15:10264:x1874208173879040:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1787384467.663386:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+16:10264:x1874208173879040:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 582us (899us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1787384467.663396:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1787384467.780987:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384467.781349:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173879168 00000100:00100000:3.0:1787384467.781361:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173879168 00000100:00100000:3.0:1787384467.781446:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:3.0:1787384467.781479:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+16:10270:x1874208173879168:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384467.781711:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384467.781742:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c36c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d52 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.781847:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c36c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.782021:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c36c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.782036:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c36c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384467.783642:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:2.0:1787384467.783654:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384467.783695:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c36c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.783754:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c36c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d52 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.783966:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c36c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d52 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.783978:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:2.0:1787384467.783981:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384467.784005:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd000, rc 0) 00000100:00100000:2.0:1787384467.784098:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+17:10270:x1874208173879168:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 2621us (3123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384467.784108:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:1.0:1787384467.792586:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.793416:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173879424 00000100:00100000:2.0:1787384467.793441:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173879424 00000100:00100000:2.0:1787384467.793545:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:2.0:1787384467.793557:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+17:10270:x1874208173879424:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384467.793586:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384467.793614:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c36cf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d59 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.793751:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c36d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.793779:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c36d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.793794:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c36d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384467.793807:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1787384467.794238:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c36cf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d59 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.794266:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c36d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d59 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.794277:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836a900) 00010000:00010000:2.0:1787384467.794302:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384467.794306:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120c00, rc 0) 00000100:00100000:2.0:1787384467.794398:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+19:10270:x1874208173879424:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 842us (1828us total) trans 4294967315 rc 0/0 00000100:00100000:2.0:1787384467.794408:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:1.0:1787384467.808989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384467.809357:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173879680 00000100:00100000:0.0:1787384467.809372:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173879680 00000100:00100000:0.0:1787384467.809459:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:0.0:1787384467.809472:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+19:10270:x1874208173879680:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384467.809508:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384467.809547:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c36e4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d60 expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.809683:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c36eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.809703:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c36eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.809720:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c36eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384467.809736:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787384467.810551:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c36e4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d60 expref: 22 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.810581:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c36eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d60 expref: 21 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384467.810591:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836a900) 00010000:00010000:0.0:1787384467.810594:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787384467.810599:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a800, rc 0) 00000100:00100000:0.0:1787384467.810701:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+21:10270:x1874208173879680:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1231us (1727us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1787384467.810711:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:1.0:1787384467.816457:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.818737:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173879808 00000100:00100000:2.0:1787384467.818761:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173879808 00000100:00100000:2.0:1787384467.818925:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:2.0:1787384467.818937:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+21:2351:x1874208173879808:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384467.818958:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384467.818991:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c36d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d59 expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.819014:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836a900) 00010000:00010000:2.0:1787384467.819019:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384467.819091:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+20:2351:x1874208173879808:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 156us (2661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384467.819099:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:1.0:1787384467.828337:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384467.828515:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173879936 00000100:00100000:3.0:1787384467.828528:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173879936 00000100:00100000:3.0:1787384467.828603:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:3.0:1787384467.828615:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173879936:12345-192.168.203.51@tcp:1:lfs.0 00010000:00010000:3.0:1787384467.828678:0:10631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.828702:0:10631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.828711:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384467.828716:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384467.828721:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.828792:0:10631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.828809:0:10631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 7 pid: 6576 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384467.828828:0:10631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10631:1874208195934208:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384467.829013:0:10631:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384467.837171:0:10631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10631:1874208195934208:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384467.837221:0:10631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384467.837264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.837454:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173880064 00000100:00100000:2.0:1787384467.837465:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173880064 00002000:00100000:2.0:1787384467.837603:0:6579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff89e3779f2d80 x1874208173880064/t0(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:498/0 lens 504/0 e 0 to 0 dl 1787384478 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787384467.837614:0:6579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e3779f2d80 with x1874208173880064 ext(0->12) 00010000:00010000:2.0:1787384467.837624:0:6579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 8 pid: 6576 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.837640:0:6579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 8 pid: 6576 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384467.837668:0:6579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89e3779f2d80 00000100:00100000:2.0:1787384467.837716:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1787384467.837726:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173880064:12345-192.168.203.51@tcp:4:lfs.0 00000001:00100000:1.0:1787384467.908095:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000100:00100000:2.0:1787384467.909622:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:2352:x1874208173880064:12345-192.168.203.51@tcp:4:lfs.0 Request processed in 71886us (72362us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1787384467.909638:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00002000:00100000:2.0:1787384467.909655:0:6579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff89e3779f2d80 x1874208173880064/t4294967299(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:498/0 lens 504/448 e 0 to 0 dl 1787384478 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787384467.909666:0:6579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e3779f2d80 with x1874208173880064 ext(0->12) 00010000:00010000:2.0:1787384467.909678:0:6579:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 9 pid: 6576 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.909703:0:6579:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 9 pid: 6576 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384467.909712:0:6579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89e3779f2d80 00000100:00100000:1.0:1787384467.913053:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.913730:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173880192 00000100:00100000:2.0:1787384467.913746:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173880192 00010000:00010000:2.0:1787384467.913805:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 9 pid: 6576 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384467.913891:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:2.0:1787384467.913904:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:2350:x1874208173880192:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384467.913943:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787384467.913978:0:5770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787384467.913982:0:5770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787384466 00002000:00010000:2.0:1787384467.913985:0:5770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787384467 00002000:00010000:2.0:1787384467.913987:0:5770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787384466 00010000:00010000:2.0:1787384467.913994:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 9 pid: 6576 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.914010:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 9 pid: 6576 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.914053:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c36ac lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d44 expref: 9 pid: 6576 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.914074:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=1s v=(1 0) 00010000:00010000:2.0:1787384467.914079:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384467.914084:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.914095:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.914134:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384467.914206:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+8:2350:x1874208173880192:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 304us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384467.914215:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 36 00010000:00010000:3.0:1787384467.915246:0:10631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.915268:0:10631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.915310:0:10631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.915319:0:10631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.915351:0:10631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.915359:0:10631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fce00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384467.915375:0:10631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.915386:0:10631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.915411:0:10631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.915421:0:10631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c36f9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384467.915558:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173879936:12345-192.168.203.51@tcp:1:lfs.0 Request processed in 86941us (87232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384467.915568:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:1.0:1787384467.918057:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384467.918225:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173880448 00000100:00100000:0.0:1787384467.918239:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173880448 00000100:00100000:0.0:1787384467.918319:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1787384467.918333:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+20:10270:x1874208173880448:12345-192.168.203.51@tcp:35:lfs.0 00000004:00010000:0.0:1787384467.918679:0:5787:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c36eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d60 expref: 20 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384467.920725:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787384467.920940:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787384467.926362:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787384467.927314:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.927342:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d36 expref: 24 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.927353:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.927530:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d36 expref: 24 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.927551:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d36 expref: 24 pid: 5785 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384467.927570:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1874208195934336:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384467.927780:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e342aa6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384467.933058:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384467.933734:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173880576 00000100:00100000:1.0:1787384467.933747:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173880576 00010000:00010000:1.0:1787384467.933805:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d36 expref: 25 pid: 5785 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384467.933853:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:1.0:1787384467.933904:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+25:2352:x1874208173880576:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384467.933924:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384467.933932:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d36 expref: 25 pid: 5785 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.933948:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d36 expref: 25 pid: 5785 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.933989:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836a900) 00010000:00010000:1.0:1787384467.933995:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.934005:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.934013:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384467.934057:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384467.934125:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+25:2352:x1874208173880576:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 223us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384467.934134:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00010000:00010000:2.0:1787384467.935970:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3690 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d36 expref: 24 pid: 5785 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384467.936005:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1874208195934336:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384467.936039:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.936050:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.936730:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384467.936983:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1787384467.937613:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1787384467.937785:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195934464:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787384467.940574:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384467.940628:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e36626aa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384467.940785:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195934464 00000100:00100000:3.0:1787384467.940801:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195934464 00000100:00100000:3.0:1787384467.940940:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787384467.940952:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1874208195934464:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787384467.941137:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1874208195934464:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 186us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384467.941606:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384467.943728:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1d180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195934464:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1787384467.944066:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787384467.950181:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1787384467.953698:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195934592:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787384467.953811:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384467.953857:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384467.954553:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195934592 00000100:00100000:0.0:1787384467.954566:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195934592 00000100:00100000:0.0:1787384467.954637:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384467.954649:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1874208195934592:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787384467.955036:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5787:x1874208195934592:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 387us (1225us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787384467.955045:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384467.955659:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275d500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195934592:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787384467.955793:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787384467.955856:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.955905:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.955915:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.955921:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384467.955926:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.955935:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.955964:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836a900) 00010000:00010000:2.0:1787384467.955979:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787384467.955986:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384467.955992:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3700 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384467.956465:0:5787:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787384467.957732:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787384467.957755:0:5787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 329100894187ns, next at 330100889682ns, rc = 0 00000001:00080000:2.0:1787384467.957769:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787384467.957840:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836a900) 00010000:00010000:2.0:1787384467.957844:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787384467.957854:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c36eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d60 expref: 28 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384467.958735:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+27:10270:x1874208173880448:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 40399us (40688us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787384467.958749:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000020:00080000:2.0:1787384467.958758:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787384467.971770:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.972089:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173880704 00000100:00100000:2.0:1787384467.972103:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173880704 00000100:00100000:3.0:1787384467.972579:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:3.0:1787384467.972593:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+27:10270:x1874208173880704:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384467.972629:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384467.972661:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3707 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d67 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.972736:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3707 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d67 expref: 28 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.972752:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3707 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d67 expref: 28 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384467.972775:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384467.972779:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384467.972783:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fce00, rc 0) 00000100:00100000:3.0:1787384467.972906:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+28:10270:x1874208173880704:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 315us (1152us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384467.972914:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:1.0:1787384467.985787:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384467.986037:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173880960 00000100:00100000:2.0:1787384467.986051:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173880960 00000100:00100000:2.0:1787384467.986378:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1787384467.986393:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350fb8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+28:10270:x1874208173880960:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1787384467.986763:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350fb8050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+29:10270:x1874208173880960:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 373us (991us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1787384467.986772:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:1.0:1787384468.102771:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384468.103327:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173881216 00000100:00100000:2.0:1787384468.103343:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173881216 00000100:00100000:2.0:1787384468.103462:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:2.0:1787384468.103475:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+29:10280:x1874208173881216:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384468.103522:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384468.103553:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c370e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d6e expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384468.103723:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1787384468.103955:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c370e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d6e expref: 31 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384468.103973:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:2.0:1787384468.103976:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384468.103982:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c370e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d6e expref: 31 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384468.103999:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120c00, rc 0) 00000100:00100000:2.0:1787384468.104083:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+30:10280:x1874208173881216:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 610us (1330us total) trans 4294967327 rc 301/301 00000100:00100000:2.0:1787384468.104091:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:0.0:1787384468.109230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384468.109669:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173881344 00000100:00100000:3.0:1787384468.109685:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173881344 00000100:00100000:3.0:1787384468.109787:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:3.0:1787384468.109800:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+30:10280:x1874208173881344:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:3.0:1787384468.110290:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c371c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110313:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c371c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110328:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c371c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110349:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3723 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110357:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110375:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110528:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110537:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110544:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384468.110603:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110618:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c371c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110639:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c371c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110646:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c371c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110652:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384468.110658:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c371c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110667:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c371c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110682:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384468.110685:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384468.110691:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c371c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110698:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c371c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110716:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3723 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.110722:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3723 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111388:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111399:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fdc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384468.111414:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3723 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111421:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3723 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111441:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e34836ab00) 00010000:00010000:3.0:1787384468.111445:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384468.111448:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3723 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111455:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3723 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111476:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111483:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111489:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111494:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384468.111497:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111502:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111509:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384468.111511:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384468.111521:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.111527:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c372a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384468.111642:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+30:10280:x1874208173881344:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 1840us (2424us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384468.111654:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:1.0:1787384468.115295:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384468.115398:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173881600 00000100:00100000:3.0:1787384468.115413:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173881600 00000100:00100000:3.0:1787384468.115554:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:3.0:1787384468.115568:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+30:10280:x1874208173881600:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1787384468.115945:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+31:10280:x1874208173881600:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 378us (664us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1787384468.115963:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:2.0:1787384468.126495:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384468.126566:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384468.126705:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173881856 00000100:00100000:3.0:1787384468.126720:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173881856 00000100:00100000:3.0:1787384468.126823:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:3.0:1787384468.126835:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173881856:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384468.126990:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173881856:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 157us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384468.126999:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:0.0:1787384468.127289:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173881728 00000100:00100000:0.0:1787384468.127296:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173881728 00000100:00100000:0.0:1787384468.127341:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 288 00000100:00100000:0.0:1787384468.127350:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173881728:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384468.127392:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173881728:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 43us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384468.127421:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 288 00000100:00080000:1.0:1787384468.127658:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384468.165222:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384468.165641:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173882112 00000100:00100000:1.0:1787384468.165656:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173882112 00000100:00100000:1.0:1787384468.165736:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:1.0:1787384468.165749:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+31:10283:x1874208173882112:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384468.165783:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384468.165811:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3731 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d75 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.165952:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3738 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166103:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166127:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166146:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c373f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166177:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c373f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166184:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c373f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166353:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166610:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166621:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384468.166635:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787384468.166775:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3738 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166783:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3738 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166789:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3738 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166795:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384468.166800:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3738 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166808:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3738 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166837:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:1.0:1787384468.166841:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384468.166847:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3738 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166854:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3738 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166917:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c373f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166923:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c373f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166929:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c373f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166934:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624ca00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384468.166937:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c373f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166943:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c373f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.166951:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e346919400) 00010000:00010000:1.0:1787384468.166953:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384468.167286:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c373f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.167294:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c373f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.167396:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3731 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d75 expref: 34 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.167413:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d75 expref: 33 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.167421:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:1.0:1787384468.167434:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384468.167438:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624cc00, rc 0) 00000100:00100000:1.0:1787384468.167545:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+33:10283:x1874208173882112:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1798us (2337us total) trans 4294967329 rc 0/0 00000100:00100000:1.0:1787384468.167555:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:1.0:1787384468.171510:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384468.171647:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173882240 00000100:00100000:3.0:1787384468.171661:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173882240 00000100:00100000:3.0:1787384468.171749:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:3.0:1787384468.171764:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+33:10283:x1874208173882240:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:3.0:1787384468.171946:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.171979:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.171994:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.172029:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.172037:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3754 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.172045:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.172051:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384468.172057:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.172065:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3754 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.172078:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384468.172082:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384468.172087:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3754 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.172093:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384468.172211:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+33:10283:x1874208173882240:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 450us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384468.172219:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:2.0:1787384468.177242:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384468.177537:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173882496 00000100:00100000:1.0:1787384468.177553:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173882496 00000100:00100000:1.0:1787384468.177640:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:1.0:1787384468.177654:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+33:10283:x1874208173882496:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1787384468.178084:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+34:10283:x1874208173882496:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 431us (858us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787384468.178094:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00010000:00010000:3.0:1787384468.489678:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384468.524989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384468.525271:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173882752 00000100:00100000:3.0:1787384468.525286:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173882752 00000100:00100000:3.0:1787384468.525362:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1787384468.525375:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+34:10314:x1874208173882752:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:3.0:1787384468.525414:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384468.525457:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c375b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d7c expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.525599:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.525618:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.525633:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384468.525647:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787384468.525837:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c375b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d7c expref: 37 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.525929:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d7c expref: 36 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.525975:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384468.525978:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384468.525982:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fdc00, rc 0) 00000100:00100000:3.0:1787384468.526126:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+36:10314:x1874208173882752:12345-192.168.203.51@tcp:101:cat.0 Request processed in 753us (1152us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1787384468.526135:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:2.0:1787384468.537116:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384468.537714:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173883008 00000100:00100000:1.0:1787384468.537728:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173883008 00000100:00100000:1.0:1787384468.537820:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:1.0:1787384468.537831:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+36:10314:x1874208173883008:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:1.0:1787384468.538279:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+37:10314:x1874208173883008:12345-192.168.203.51@tcp:35:cat.0 Request processed in 448us (1177us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787384468.538306:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:0.0:1787384468.544351:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384468.544650:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173883136 00000100:00100000:1.0:1787384468.544665:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173883136 00000100:00100000:1.0:1787384468.544752:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:1.0:1787384468.544944:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+37:2350:x1874208173883136:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384468.544975:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384468.545009:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d7c expref: 37 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.545034:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:1.0:1787384468.545040:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384468.545324:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441d9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+36:2350:x1874208173883136:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 561us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384468.545333:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:0.0:1787384468.643200:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384468.643322:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173883392 00000100:00100000:3.0:1787384468.643336:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173883392 00000100:00100000:3.0:1787384468.643416:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:3.0:1787384468.643437:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+36:10320:x1874208173883392:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:3.0:1787384468.643472:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384468.643476:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787384468.643518:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c36c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d52 expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.643547:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384468.643553:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384468.643570:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3770 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d83 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.643710:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.643729:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d75 expref: 36 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.643763:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.643811:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d75 expref: 36 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.643829:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d75 expref: 36 pid: 5783 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384468.643847:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195934720:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384468.644040:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384468.650910:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384468.651050:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195934720:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384468.651085:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384468.651271:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173883520 00000100:00100000:1.0:1787384468.651282:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173883520 00010000:00010000:1.0:1787384468.651334:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d75 expref: 37 pid: 5783 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384468.651385:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:1.0:1787384468.651396:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+37:2353:x1874208173883520:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384468.651416:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384468.651434:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d75 expref: 37 pid: 5783 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.651448:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d75 expref: 37 pid: 5783 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.651939:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3746 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d75 expref: 37 pid: 5783 timeout: 429 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.651967:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:1.0:1787384468.651973:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.651984:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.651992:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384468.652159:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384468.652238:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+36:2353:x1874208173883520:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 840us (1379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384468.652247:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00010000:00010000:3.0:1787384468.657028:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.657052:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384468.657090:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787384468.660554:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3770 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d83 expref: 37 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.660594:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d83 expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.660629:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384468.660633:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787384468.660638:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd200, rc 0) 00000100:00100000:3.0:1787384468.660814:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+36:10320:x1874208173883392:12345-192.168.203.51@tcp:101:dd.0 Request processed in 17379us (17628us total) trans 4294967333 rc 0/0 00000100:00100000:3.0:1787384468.660825:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:2.0:1787384468.671478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384468.672596:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173883776 00000100:00100000:3.0:1787384468.672626:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173883776 00000100:00100000:3.0:1787384468.672724:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:3.0:1787384468.672738:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+36:10320:x1874208173883776:12345-192.168.203.51@tcp:36:dd.0 00010000:00010000:3.0:1787384468.673237:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.673261:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.673276:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384468.673335:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:3.0:1787384468.673362:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000039b10d50 reply state 00000000156d91dd transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384468.673373:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384468.673512:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+39:10320:x1874208173883776:12345-192.168.203.51@tcp:36:dd.0 Request processed in 775us (2049us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1787384468.673522:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000020:00080000:3.0:1787384468.673538:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787384468.680346:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.680369:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.680377:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.680383:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384468.680389:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.680398:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.680430:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384468.680434:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384468.680439:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.680445:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3785 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384468.998482:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384468.998632:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173883904 00000100:00100000:3.0:1787384468.998648:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173883904 00000100:00100000:3.0:1787384468.998736:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:3.0:1787384468.998749:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+38:10334:x1874208173883904:12345-192.168.203.51@tcp:101:stat.0 00010000:00010000:3.0:1787384468.998783:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384468.998812:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c378c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d8a expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.998947:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3793 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.998977:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3793 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.998993:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3793 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.999011:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c379a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.999018:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c379a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.999025:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c379a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.999169:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.999181:0:7691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d83 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.999189:0:7691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.999237:0:7691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d83 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384468.999268:0:7691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d83 expref: 39 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384468.999286:0:7691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195934848:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384468.999417:0:7691:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8000 going to sleep for 11 seconds 00000100:00100000:3.0:1787384469.003042:0:7691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195934848:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384469.003081:0:7691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384469.004814:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384469.005154:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173884160 00000100:00100000:1.0:1787384469.005168:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173884160 00000100:00100000:1.0:1787384469.005265:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:1.0:1787384469.005278:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+40:5566:x1874208173884160:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787384469.005752:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+41:5566:x1874208173884160:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 475us (947us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787384469.005762:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00080000:0.0:1787384469.006113:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384469.009293:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384469.009465:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173884288 00000100:00100000:2.0:1787384469.009479:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173884288 00010000:00010000:2.0:1787384469.009544:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d83 expref: 41 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384469.009590:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:2.0:1787384469.009600:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+41:2350:x1874208173884288:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384469.009620:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384469.009629:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d83 expref: 41 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.009643:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d83 expref: 41 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.009671:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3777 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d83 expref: 41 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.009692:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:2.0:1787384469.009699:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.009711:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.009719:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.009755:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384469.009842:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+40:2350:x1874208173884288:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 242us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384469.009851:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00010000:00010000:3.0:1787384469.011824:0:7691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.011848:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384469.011985:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787384469.011991:0:7691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384469.012055:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012074:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012086:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3793 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012094:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3793 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012126:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3793 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012143:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384469.012149:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3793 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012158:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3793 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012176:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384469.012180:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384469.012184:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3793 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012191:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3793 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012211:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c379a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012218:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c379a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012224:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c379a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012230:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fdc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384469.012233:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c379a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012250:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c379a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012260:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e34836ab00) 00010000:00010000:3.0:1787384469.012262:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384469.012265:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c379a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012272:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c379a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012327:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c378c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d8a expref: 40 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012342:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d8a expref: 39 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.012349:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384469.012352:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384469.012354:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031400, rc 0) 00000100:00100000:3.0:1787384469.012442:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+39:10334:x1874208173883904:12345-192.168.203.51@tcp:101:stat.0 Request processed in 13693us (13975us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384469.012452:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:2.0:1787384469.093012:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384469.093174:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173884544 00000100:00100000:3.0:1787384469.093187:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173884544 00000100:00100000:3.0:1787384469.093264:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:3.0:1787384469.093277:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+39:10340:x1874208173884544:12345-192.168.203.51@tcp:36:truncate.0 00010000:00010000:3.0:1787384469.093374:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384469.093412:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d8a expref: 39 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.093447:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384469.093452:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384469.093736:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.093752:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.093763:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384469.093821:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1787384469.093850:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008465d18d reply state 00000000d67586c8 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384469.093935:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384469.094093:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+41:10340:x1874208173884544:12345-192.168.203.51@tcp:36:truncate.0 Request processed in 818us (1094us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1787384469.094102:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 54 00000020:00080000:3.0:1787384469.094107:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787384469.098119:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.098154:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.098163:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.098170:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384469.098177:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.098186:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.098210:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:2.0:1787384469.098213:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384469.098218:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.098225:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c37a8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384469.280033:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384469.280155:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173884672 00000100:00100000:3.0:1787384469.280168:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173884672 00000100:00100000:3.0:1787384469.280243:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:3.0:1787384469.280256:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+40:10354:x1874208173884672:12345-192.168.203.51@tcp:101:stat.0 00010000:00010000:3.0:1787384469.280287:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384469.280333:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37af lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d91 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280431:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37b6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280446:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280459:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280475:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37bd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280481:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280487:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280611:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280621:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280628:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384469.280679:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1787384469.280685:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384469.280715:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280738:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280749:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37b6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280756:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37b6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280762:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280769:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384469.280774:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280784:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37b6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280799:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384469.280801:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384469.280806:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280813:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280828:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37bd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280834:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37bd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280847:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280852:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384469.280855:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37bd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280926:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37bd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280935:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e34836ab00) 00010000:00010000:3.0:1787384469.280937:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384469.280940:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37bd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280946:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37bd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.280986:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d91 expref: 42 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.281001:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d91 expref: 41 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.281010:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384469.281012:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384469.281015:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030400, rc 0) 00000100:00100000:3.0:1787384469.281100:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+41:10354:x1874208173884672:12345-192.168.203.51@tcp:101:stat.0 Request processed in 846us (1085us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384469.281121:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:0.0:1787384469.410732:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384469.410854:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173884928 00000100:00100000:3.0:1787384469.410902:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173884928 00000100:00100000:3.0:1787384469.411008:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:3.0:1787384469.411021:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+41:10364:x1874208173884928:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384469.411054:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384469.411084:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37cb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d98 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384469.411527:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1787384469.411692:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37cb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d98 expref: 43 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.411713:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:3.0:1787384469.411716:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384469.411723:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37cb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d98 expref: 43 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.411744:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031400, rc 0) 00000100:00100000:3.0:1787384469.411838:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+42:10364:x1874208173884928:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 819us (1121us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1787384469.411846:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:0.0:1787384469.421753:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384469.421913:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173885184 00000100:00100000:1.0:1787384469.421942:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173885184 00000100:00100000:1.0:1787384469.422028:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:1.0:1787384469.422065:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+42:10364:x1874208173885184:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1787384469.422462:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+43:10364:x1874208173885184:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 400us (725us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787384469.422471:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1787384469.496313:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384469.496510:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173885440 00000100:00100000:3.0:1787384469.496523:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173885440 00000100:00100000:3.0:1787384469.496614:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:3.0:1787384469.496627:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+43:10370:x1874208173885440:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1787384469.496685:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384469.496714:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78d9f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.496852:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.496909:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d91 expref: 44 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.496919:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.496964:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d91 expref: 44 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.496981:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d91 expref: 44 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384469.496998:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195934976:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384469.497141:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384469.500928:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384469.501744:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173885568 00000100:00100000:1.0:1787384469.501760:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173885568 00010000:00010000:1.0:1787384469.501823:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d91 expref: 45 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384469.501977:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:1.0:1787384469.501990:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+45:2352:x1874208173885568:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384469.502009:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384469.502017:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d91 expref: 45 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.502032:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d91 expref: 45 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.502064:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:1.0:1787384469.502070:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.502073:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c37c4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d91 expref: 45 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.502081:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.502091:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384469.502094:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195934976:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384469.502129:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.502137:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384469.502158:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.502164:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384469.502189:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000100:00100000:1.0:1787384469.502202:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+44:2352:x1874208173885568:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 215us (1343us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384469.502210:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00010000:00010000:3.0:1787384469.502424:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c37d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d9f expref: 45 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.502441:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d9f expref: 44 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.502448:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384469.502451:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787384469.502453:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030000, rc 0) 00000100:00100000:3.0:1787384469.502660:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+44:10370:x1874208173885440:12345-192.168.203.51@tcp:101:bash.0 Request processed in 6034us (6361us total) trans 4294967341 rc 0/0 00000100:00100000:3.0:1787384469.502668:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:0.0:1787384469.506637:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:2.0:1787384469.514893:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384469.519311:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173885824 00000100:00100000:3.0:1787384469.519335:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173885824 00000100:00100000:3.0:1787384469.519431:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:3.0:1787384469.519445:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+44:10370:x1874208173885824:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:3.0:1787384469.519917:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.519941:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.522643:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384469.522834:0:5783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1787384469.523671:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000de059984 reply state 00000000d0553bb7 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384469.523691:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384469.523942:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+47:10370:x1874208173885824:12345-192.168.203.51@tcp:36:bash.0 Request processed in 4480us (17299us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1787384469.525822:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00000020:00080000:3.0:1787384469.525833:0:5783:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787384469.530320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:3.0:1787384469.530921:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.530955:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.530964:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.530970:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384469.530977:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.530987:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.531011:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384469.531014:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384469.531035:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.531043:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c37ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384469.533153:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173885952 00000100:00100000:2.0:1787384469.533194:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173885952 00000100:00100000:2.0:1787384469.533285:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:2.0:1787384469.533298:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+46:10370:x1874208173885952:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384469.533333:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384469.533364:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c37f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78da6 expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.533782:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.534001:0:7691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d9f expref: 47 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.534013:0:7691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.534073:0:7691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d9f expref: 47 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.534092:0:7691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d9f expref: 47 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384469.534112:0:7691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e34306b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195935104:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384469.534243:0:7691:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384469.543008:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384469.543617:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173886080 00000100:00100000:3.0:1787384469.543633:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173886080 00010000:00010000:3.0:1787384469.543690:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d9f expref: 48 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384469.543755:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:3.0:1787384469.543768:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+48:2353:x1874208173886080:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384469.543788:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384469.543795:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d9f expref: 48 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.543811:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d9f expref: 48 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.543844:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384469.543850:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.543885:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.543896:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.543923:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384469.544311:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+48:2353:x1874208173886080:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 543us (1316us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384469.544321:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00010000:00010000:2.0:1787384469.545174:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c37e0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d9f expref: 47 pid: 5785 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384469.545203:0:7691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e34306b800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195935104:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384469.545251:0:7691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.545262:0:7691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.545269:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384469.545333:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787384469.545337:0:7691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384469.545365:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.545412:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c37f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78da6 expref: 47 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.545444:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78da6 expref: 46 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.545454:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:2.0:1787384469.545458:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384469.545462:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120c00, rc 0) 00000100:00100000:2.0:1787384469.545530:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+46:10370:x1874208173885952:12345-192.168.203.51@tcp:101:bash.0 Request processed in 12234us (15228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384469.545541:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:0.0:1787384469.551236:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384469.551610:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173886336 00000100:00100000:1.0:1787384469.551625:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173886336 00000100:00100000:1.0:1787384469.551700:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:1.0:1787384469.551713:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+46:10370:x1874208173886336:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:1.0:1787384469.552116:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350fb9c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+47:10370:x1874208173886336:12345-192.168.203.51@tcp:35:bash.0 Request processed in 404us (904us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1787384469.552127:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:2.0:1787384469.654299:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384469.654623:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173886592 00000100:00100000:0.0:1787384469.654638:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173886592 00000100:00100000:0.0:1787384469.654987:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:0.0:1787384469.655001:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+47:10380:x1874208173886592:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384469.655034:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384469.655063:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3803 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78dad expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384469.655854:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787384469.659063:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3803 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dad expref: 49 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.659092:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:0.0:1787384469.659119:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384469.659127:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3803 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dad expref: 49 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.659147:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108aa00, rc 0) 00000100:00100000:0.0:1787384469.659244:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+48:10380:x1874208173886592:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 4245us (4959us total) trans 4294967345 rc 301/301 00000100:00100000:0.0:1787384469.659255:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00000001:00080000:1.0:1787384469.670393:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967317 is committed 00000001:00080000:1.0:1787384469.670432:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967344 is committed 00000004:00080000:1.0:1787384469.670460:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787384469.670547:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e36626ab40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787384469.670554:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e37b6b5500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e36626aa80 00000020:00080000:1.0:1787384469.670558:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e37b6b5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e37baf4800 00000100:00100000:3.0:1787384469.670842:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384469.670908:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195935232:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787384469.670999:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384469.671139:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195935232 00000100:00100000:0.0:1787384469.671149:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195935232 00000100:00100000:0.0:1787384469.671224:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787384469.671237:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3307:x1874208195935232:12345-0@lo:6:osp-syn-0-0.0 00000100:00080000:1.0:1787384469.671243:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:0.0:1787384469.671273:0:6574:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787384469.671320:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a895292, atime: 0x6a895293, ctime: 0x6a895292, blocks: 0x1 00010000:00010000:0.0:1787384469.671330:0:6574:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3811 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.671350:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:0.0:1787384469.671355:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384469.671363:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.671384:0:6574:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.671396:0:6574:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3811 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.671447:0:6574:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.671594:0:6574:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384469.671894:0:8293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384469.671904:0:8293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.671918:0:8293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384469.671924:0:8293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3811 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.671961:0:8293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3811 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.671989:0:8293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3811 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.671999:0:8293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3811 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.672028:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384469.672030:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384469.672032:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787384469.672910:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000004:00080000:1.0:1787384469.672981:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e3733d3480/2, rc 0, transno 4294967301 00000100:00100000:1.0:1787384469.672993:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195935232:0@lo:6:osp-syn-0-0.0 00000020:00080000:2.0:1787384469.673010:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:2.0:1787384469.673776:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384469.673929:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173886720 00000100:00100000:3.0:1787384469.673939:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173886720 00000100:00100000:3.0:1787384469.674001:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:3.0:1787384469.674012:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+12:10380:x1874208173886720:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:3.0:1787384469.674106:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3818 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.674126:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.674140:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.674158:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c381f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.674165:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c381f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.674173:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c381f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384469.674585:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3307:x1874208195935232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3348us (3582us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1787384469.674598:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1787384469.675398:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675645:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675658:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384469.675786:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675803:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3818 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675811:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3818 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675819:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3818 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675825:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384469.675830:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3818 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675838:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3818 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675852:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384469.675856:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384469.675891:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3818 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675898:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3818 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675923:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c381f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675929:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c381f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675936:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c381f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675942:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384469.675945:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c381f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675950:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c381f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675959:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e34836ab00) 00010000:00010000:3.0:1787384469.675962:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384469.675965:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c381f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675971:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c381f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675989:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.675995:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.676001:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.676013:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384469.676016:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.676023:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.676031:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384469.676034:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384469.676037:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.676042:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384469.676221:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+12:10380:x1874208173886720:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 2206us (2446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384469.676233:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:2.0:1787384469.686523:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384469.686678:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173886976 00000100:00100000:3.0:1787384469.686692:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173886976 00000100:00100000:3.0:1787384469.686843:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1787384469.686856:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+12:10380:x1874208173886976:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1787384469.688081:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+13:10380:x1874208173886976:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 1220us (1569us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787384469.688094:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1787384469.726102:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384469.726217:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173887232 00000100:00100000:3.0:1787384469.726230:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173887232 00000100:00100000:3.0:1787384469.726309:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:3.0:1787384469.726321:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+13:10383:x1874208173887232:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384469.726355:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384469.726381:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c382d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78db4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.727655:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3834 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.727676:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.727690:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.727707:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c383b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.729810:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c383b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384469.729934:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c383b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.730686:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3842 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.730703:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.730713:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3842 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384469.731562:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787384469.732510:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3834 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732528:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3834 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732536:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732544:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384469.732549:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3834 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732559:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3834 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732607:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:2.0:1787384469.732610:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384469.732616:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3834 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732623:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3834 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732642:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c383b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732649:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c383b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732654:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c383b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732660:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384469.732663:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c383b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732669:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c383b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732677:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e34836ab00) 00010000:00010000:2.0:1787384469.732679:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384469.732682:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c383b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.732688:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c383b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.736614:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c382d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78db4 expref: 16 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.736654:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3842 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78db4 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.736665:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:0.0:1787384469.736668:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384469.736672:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120400, rc 0) 00000100:00100000:0.0:1787384469.736787:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+15:10383:x1874208173887232:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 10466us (10700us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1787384469.736798:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:0.0:1787384469.743967:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384469.744017:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384469.744114:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173887488 00000100:00100000:2.0:1787384469.744128:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173887488 00000100:00100000:2.0:1787384469.744198:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:2.0:1787384469.744210:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+15:10383:x1874208173887488:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:2.0:1787384469.744317:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3850 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.744340:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.744354:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.744388:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3850 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.744396:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3850 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.744421:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.744428:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384469.744434:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3850 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.744443:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3850 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.744457:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:2.0:1787384469.744476:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384469.744483:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3850 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384469.744491:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3850 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384469.744582:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+15:10383:x1874208173887488:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 373us (629us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384469.744590:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:1.0:1787384469.745157:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173887360 00000100:00100000:1.0:1787384469.745165:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173887360 00000100:00100000:1.0:1787384469.745222:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:1.0:1787384469.745232:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+15:2350:x1874208173887360:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384469.745246:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384469.745269:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3842 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78db4 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384469.745285:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:1.0:1787384469.745288:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384469.745323:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+14:2350:x1874208173887360:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 93us (1305us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384469.745340:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:0.0:1787384469.750975:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384469.751070:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173887744 00000100:00100000:1.0:1787384469.751083:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173887744 00000100:00100000:1.0:1787384469.751149:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1787384469.751160:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+14:10383:x1874208173887744:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1787384469.751658:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+15:10383:x1874208173887744:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 496us (694us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1787384469.751668:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:2.0:1787384469.969525:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384469.969728:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173888000 00000100:00100000:0.0:1787384469.969742:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173888000 00000100:00100000:0.0:1787384469.969827:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:0.0:1787384469.969840:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+15:10401:x1874208173888000:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:0.0:1787384469.969919:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384469.969963:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3857 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78dbb expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.970113:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c385e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.970142:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c385e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.970163:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c385e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384469.970180:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787384469.970383:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3857 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dbb expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.970410:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c385e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dbb expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384469.970428:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:0.0:1787384469.970431:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787384469.970435:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108bc00, rc 0) 00000100:00100000:0.0:1787384469.970776:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+17:10401:x1874208173888000:12345-192.168.203.51@tcp:101:cat.0 Request processed in 937us (1274us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1787384469.970785:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:0.0:1787384470.000679:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384470.000794:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173888128 00000100:00100000:2.0:1787384470.000808:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173888128 00000100:00100000:2.0:1787384470.000936:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:2.0:1787384470.001074:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+17:10402:x1874208173888128:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384470.001110:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384470.001151:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c386c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78dc2 expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.001257:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3873 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.001276:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.001293:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384470.001597:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787384470.001603:0:7691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384470.001701:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3873 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.001742:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c386c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc2 expref: 19 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.001764:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3873 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc2 expref: 18 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.001774:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:2.0:1787384470.001778:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384470.001784:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120400, rc 0) 00000100:00100000:2.0:1787384470.001929:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+18:10402:x1874208173888128:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 862us (1264us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384470.001938:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:1.0:1787384470.015229:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384470.015455:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173888512 00000100:00100000:2.0:1787384470.015473:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173888512 00000100:00100000:2.0:1787384470.015572:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1787384470.015584:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+18:10402:x1874208173888512:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1787384470.016312:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+19:10402:x1874208173888512:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 725us (1094us total) trans 4294967350 rc 0/0 00000100:00100000:2.0:1787384470.016322:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:0.0:1787384470.019546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.019730:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173888640 00000100:00100000:3.0:1787384470.019742:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173888640 00000100:00100000:3.0:1787384470.019829:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:3.0:1787384470.019840:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+19:10402:x1874208173888640:12345-192.168.203.51@tcp:103:lfs.0 00010000:00010000:3.0:1787384470.019884:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1787384470.019919:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c37fc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78da6 expref: 19 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.020027:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c385e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dbb expref: 18 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.020070:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3707 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d67 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.020084:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384470.020109:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384470.020189:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+16:10402:x1874208173888640:12345-192.168.203.51@tcp:103:lfs.0 Request processed in 350us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.020198:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:3.0:1787384470.022725:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384470.022963:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173888768 00000100:00100000:0.0:1787384470.022995:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173888768 00000100:00100000:0.0:1787384470.023068:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:0.0:1787384470.023079:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+16:10402:x1874208173888768:12345-192.168.203.51@tcp:58:lfs.0 00010000:00010000:0.0:1787384470.023249:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c387a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.023267:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c387a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.023280:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c387a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384470.024133:0:5784:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384470.024341:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1787384470.024437:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1787384470.024580:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+16:10402:x1874208173888768:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 1497us (1864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384470.024593:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:0.0:1787384470.047762:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.047899:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173888896 00000100:00100000:3.0:1787384470.047913:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173888896 00000100:00100000:3.0:1787384470.047996:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:3.0:1787384470.048009:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+16:10404:x1874208173888896:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384470.048036:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384470.048063:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3881 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78dc9 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.048329:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3888 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.048346:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3888 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.048358:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3888 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.048375:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c388f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.048400:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c388f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.048407:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c388f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.048810:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.048820:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.048828:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384470.048910:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787384470.048916:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384470.049439:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049457:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049466:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3888 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049473:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3888 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049479:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3888 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049606:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384470.049612:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3888 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049621:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3888 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049637:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384470.049640:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384470.049645:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3888 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049652:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3888 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049670:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c388f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049676:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c388f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049681:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c388f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049687:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384470.049689:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c388f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049695:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c388f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049715:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e34836af00) 00010000:00010000:3.0:1787384470.049718:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384470.049720:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c388f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049726:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c388f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049775:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3881 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc9 expref: 18 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049792:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc9 expref: 17 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.049798:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e343ce4e00) 00010000:00010000:3.0:1787384470.049801:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384470.049803:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030000, rc 0) 00000100:00100000:3.0:1787384470.050072:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+17:10404:x1874208173888896:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 2063us (2322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.050082:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:0.0:1787384470.090447:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384470.090477:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37275dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195935360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384470.090581:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384470.090780:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195935360 00000100:00100000:2.0:1787384470.090790:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195935360 00000100:00100000:2.0:1787384470.090857:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787384470.090887:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874208195935360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384470.090936:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384470.091014:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874208195935360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384470.091046:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787384470.091286:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37275dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195935360:0@lo:13:osp-pre-0-0.0 00000040:00080000:1.0:1787384470.474699:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384470.474709:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384470.474811:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787384470.474819:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384470.475083:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195935488:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787384470.475226:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3510b0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384470.487800:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384470.487923:0:5794:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173889024 00000100:00100000:2.0:1787384470.487937:0:5794:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173889024 00000100:00100000:2.0:1787384470.488005:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:2.0:1787384470.488016:0:5794:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ddc9253f-47aa-4509-981d-645f91ec7250+18:10415:x1874208173889024:12345-192.168.203.51@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787384470.488141:0:5794:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:ddc9253f-47aa-4509-981d-645f91ec7250+18:10415:x1874208173889024:12345-192.168.203.51@tcp:900:lhsmtool_posix.0 Request processed in 126us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384470.488150:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:1.0:1787384470.488489:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d0e00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195935488:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787384470.506665:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384470.511349:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173889152 00000100:00100000:0.0:1787384470.511371:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173889152 00000100:00100000:0.0:1787384470.511475:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:0.0:1787384470.511487:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+17:10415:x1874208173889152:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787384470.511567:0:5784:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787384470.511807:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+17:10415:x1874208173889152:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 245us (5075us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384470.511817:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:1.0:1787384470.519773:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.520114:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173889280 00000100:00100000:3.0:1787384470.520130:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173889280 00000100:00100000:3.0:1787384470.520197:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:3.0:1787384470.520208:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+17:10415:x1874208173889280:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787384470.520278:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c389d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522072:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c389d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522087:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c389d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522113:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522120:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522128:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522155:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522163:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522169:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384470.522209:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787384470.522212:0:7691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384470.522226:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522236:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c389d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522257:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c389d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522264:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c389d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522270:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384470.522274:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c389d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.522281:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c389d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523629:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:3.0:1787384470.523639:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384470.523647:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c389d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523657:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c389d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523681:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523688:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38a4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523696:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523702:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384470.523724:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523732:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38a4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523743:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff89e34836af00) 00010000:00010000:3.0:1787384470.523746:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384470.523749:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38a4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523755:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523775:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523782:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523788:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523793:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384470.523796:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523801:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523808:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e343ce4e00) 00010000:00010000:3.0:1787384470.523810:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384470.523819:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.523825:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38ab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384470.523977:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+17:10415:x1874208173889280:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 3767us (4214us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.523988:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:0.0:1787384470.536665:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384470.537433:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173889536 00000100:00100000:1.0:1787384470.537447:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173889536 00000100:00100000:1.0:1787384470.537525:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:1.0:1787384470.537536:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+17:10415:x1874208173889536:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384470.537562:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384470.537588:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78dd0 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.537803:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c38b9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.537835:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c38b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.537849:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c38b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384470.537887:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1787384470.538015:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c38b9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.538022:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c38b9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.538030:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c38b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.538037:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624dc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384470.538041:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c38b9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.538050:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c38b9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.538064:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e343ce4e00) 00010000:00010000:1.0:1787384470.538068:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384470.538072:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c38b9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.538079:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c38b9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.538126:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38b2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dd0 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.538142:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:1.0:1787384470.538145:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384470.538149:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dd0 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.538159:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d600, rc 0) 00000100:00100000:1.0:1787384470.538718:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+18:10415:x1874208173889536:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1168us (2049us total) trans 4294967351 rc 301/301 00010000:00010000:3.0:1787384470.539075:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384470.539566:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:3.0:1787384470.549219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.549254:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173889664 00000100:00100000:3.0:1787384470.549264:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173889664 00000100:00100000:3.0:1787384470.549322:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:3.0:1787384470.549335:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+18:10415:x1874208173889664:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787384470.549387:0:5785:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787384470.549504:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+18:10415:x1874208173889664:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 171us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.549511:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:3.0:1787384470.558605:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.558646:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173889920 00000100:00100000:3.0:1787384470.558657:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173889920 00000100:00100000:3.0:1787384470.558708:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:3.0:1787384470.558718:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+18:10415:x1874208173889920:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384470.558738:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384470.558742:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787384470.558767:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3873 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc2 expref: 18 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.558804:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384470.558809:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384470.558825:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38c7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78dd7 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787384470.559639:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1787384470.559952:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38ce lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.559967:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.559979:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38ce lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.560041:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38c7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dd7 expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.560060:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38ce lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dd7 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.560067:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384470.560069:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384470.560072:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031400, rc 0) 00000100:00100000:3.0:1787384470.560149:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+19:10415:x1874208173889920:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1431us (1553us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1787384470.560158:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:0.0:1787384470.582247:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.582406:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173890176 00000100:00100000:3.0:1787384470.582428:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173890176 00000100:00100000:3.0:1787384470.582505:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:3.0:1787384470.582517:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+19:10415:x1874208173890176:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384470.582597:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384470.582631:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c38ce lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dd7 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.582655:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e34836af00) 00010000:00010000:3.0:1787384470.582672:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384470.582702:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c38dc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.582718:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c38dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.582741:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c38dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.584427:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38e3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x4f0383f2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.584452:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f0383f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.584464:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f0383f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.584929:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c38dc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.584948:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c38dc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.584955:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c38dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.584960:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384470.584965:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c38dc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.584973:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c38dc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.584986:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384470.584989:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384470.584994:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c38dc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.585000:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c38dc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.585013:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38e3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f0383f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.585019:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38e3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f0383f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.585024:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f0383f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.585030:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384470.585038:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38e3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f0383f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.585045:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38e3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x4f0383f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.585053:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x4f0383f2 (ffff89e34836aa00) 00010000:00010000:3.0:1787384470.585056:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384470.585058:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38e3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4f0383f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.585064:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38e3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x4f0383f2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384470.585320:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+18:10415:x1874208173890176:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 2657us (2941us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384470.585332:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:3.0:1787384470.590894:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384470.591110:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173890304 00000100:00100000:0.0:1787384470.591128:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173890304 00000100:00100000:0.0:1787384470.591214:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:0.0:1787384470.591228:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+18:10415:x1874208173890304:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384470.591257:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384470.591290:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c38ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78dde expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.591334:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.591357:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.591374:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.591524:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c38ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dde expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.591551:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dde expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.591652:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:0.0:1787384470.591656:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384470.591661:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b200, rc 0) 00000100:00100000:0.0:1787384470.591846:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+19:10415:x1874208173890304:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 617us (980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384470.591854:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:2.0:1787384470.594983:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.595084:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173890560 00000100:00100000:3.0:1787384470.595103:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173890560 00000100:00100000:3.0:1787384470.595173:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 75 00000100:00100000:3.0:1787384470.595184:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+19:10415:x1874208173890560:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384470.595272:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.595290:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.595301:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384470.596075:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1787384470.596090:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331739229714ns, next at 332739226603ns, rc = 0 00000004:00010000:3.0:1787384470.596179:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003271b830 reply state 000000007fa0c8ca transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384470.596189:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384470.596307:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+21:10415:x1874208173890560:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 1123us (1335us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787384470.596318:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 75 00010000:00010000:1.0:1787384470.599779:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.599798:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.599807:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.599816:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384470.599823:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.599834:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.599886:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:1.0:1787384470.599891:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787384470.599897:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.599914:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c38f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384470.602391:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195935872:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.602505:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384470.602591:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384470.602601:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195936000:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.602631:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.602665:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195935744:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.602685:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195935872 00000100:00100000:1.0:1787384470.602699:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195935872 00000100:00100000:3.0:1787384470.602764:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.602822:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1787384470.602833:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195935616:0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.602992:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.603031:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195936128:0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.603066:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.603405:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.607907:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195935616 00000100:00100000:3.0:1787384470.607920:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195935616 00000100:00100000:3.0:1787384470.608003:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787384470.608015:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195935616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.608104:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195935616:12345-0@lo:400:kworker.0 Request processed in 92us (5112us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.608111:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:3.0:1787384470.608149:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195936128 00000100:00100000:3.0:1787384470.608167:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195936128 00000100:00100000:3.0:1787384470.608226:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787384470.608233:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195936128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.608271:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195936128:12345-0@lo:400:kworker.0 Request processed in 38us (5203us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.608277:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787384470.608395:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195935616:0@lo:400:kworker.0 00000100:00100000:3.0:1787384470.608420:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195936128:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.610433:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195936000 00000100:00100000:1.0:1787384470.610453:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195936000 00000100:00100000:1.0:1787384470.610522:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195935744 00000100:00100000:1.0:1787384470.610526:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195935744 00000100:00100000:1.0:1787384470.610539:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173890688 00000100:00100000:1.0:1787384470.610542:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173890688 00000100:00100000:1.0:1787384470.610564:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787384470.610575:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195935872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.610698:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195935872:12345-0@lo:400:kworker.0 Request processed in 124us (8193us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.610720:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1787384470.610750:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787384470.610757:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195936000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.610790:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195936000:12345-0@lo:400:kworker.0 Request processed in 33us (8159us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.610796:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1787384470.610809:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787384470.610824:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195935744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.610887:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195935744:12345-0@lo:400:kworker.0 Request processed in 64us (8126us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.610893:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787384470.610909:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 76 00000100:00100000:1.0:1787384470.610916:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+20:10415:x1874208173890688:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384470.610937:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384470.610965:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38ff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78de5 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.611042:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78de5 expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.611061:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78de5 expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.611087:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:1.0:1787384470.611092:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384470.611097:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d600, rc 0) 00000100:00100000:1.0:1787384470.611426:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+21:10415:x1874208173890688:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 508us (8232us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.611433:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 76 00000100:00080000:1.0:1787384470.611468:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384470.611476:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384470.611662:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195936000:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.611679:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195935872:0@lo:400:kworker.0 00000100:00100000:1.0:1787384470.611854:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195935744:0@lo:400:kworker.0 00000100:00100000:0.0:1787384470.619766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.620548:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173890816 00000100:00100000:3.0:1787384470.620558:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173890816 00000100:00100000:3.0:1787384470.620599:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:3.0:1787384470.620609:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1874208173890816:12345-192.168.203.51@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1787384470.620650:0:6576:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp t0 exp 0000000000000000 cur 331 last 0 00000020:00000080:3.0:1787384470.620686:0:6576:0:(genops.c:1406:class_connect()) connect: client ddc9253f-47aa-4509-981d-645f91ec7250, cookie 0x3522fbed3b6c3906 00002000:00100000:3.0:1787384470.620699:0:6576:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ddc9253f-47aa-4509-981d-645f91ec7250/ffff89e3727a9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787384470.620723:0:6576:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787384470.621079:0:6576:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787384470.621114:0:6576:0:(import.c:65:import_set_state_nolock()) ffff89e3727ab000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384470.621209:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2349:x1874208173890816:12345-192.168.203.51@tcp:8:lhsmtool_posix.0 Request processed in 599us (1453us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.621217:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:1.0:1787384470.625584:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.625670:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173890944 00000100:00100000:3.0:1787384470.625687:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173890944 00000100:00100000:3.0:1787384470.625770:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:3.0:1787384470.625781:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:0:x1874208173890944:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1787384470.626050:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1787384470.672543:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1787384470.672560:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000100:00100000:3.0:1787384470.672760:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:0:x1874208173890944:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 46975us (47189us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1787384470.672771:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:1.0:1787384470.687294:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384470.687387:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173891200 00000100:00100000:2.0:1787384470.687398:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173891200 00000100:00100000:2.0:1787384470.687469:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1787384470.687480:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+21:10415:x1874208173891200:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787384470.687739:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+22:10415:x1874208173891200:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 261us (455us total) trans 4294967354 rc 0/0 00000100:00100000:2.0:1787384470.687748:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:0.0:1787384470.693808:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384470.694058:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173891456 00000100:00100000:1.0:1787384470.694067:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173891456 00000100:00100000:1.0:1787384470.694128:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00100000:1.0:1787384470.694138:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+22:10415:x1874208173891456:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787384470.694252:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+22:10415:x1874208173891456:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 114us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.694260:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00100000:1.0:1787384470.705838:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384470.705973:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173891584 00000100:00100000:0.0:1787384470.705982:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173891584 00000100:00100000:0.0:1787384470.706039:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 78 00000100:00100000:0.0:1787384470.706049:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+22:10415:x1874208173891584:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384470.706068:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384470.706087:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c390d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78dec expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.706158:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.706171:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.706182:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384470.706216:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384470.706232:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.706271:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c390d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dec expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.706287:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dec expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.706296:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:0.0:1787384470.706299:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787384470.706302:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a600, rc 0) 00000100:00100000:0.0:1787384470.706353:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+23:10415:x1874208173891584:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 306us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384470.706360:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 78 00000100:00100000:2.0:1787384470.713295:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.713372:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173891712 00000100:00100000:3.0:1787384470.713382:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173891712 00000100:00100000:3.0:1787384470.713441:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:3.0:1787384470.713451:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173891712:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384470.713469:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384470.713488:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053a45d19/0x3522fbed3b6c391b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78df3 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384470.713516:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a895295, blocks: 0x1 00010000:00010000:3.0:1787384470.713534:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1787384470.713538:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384470.713547:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053a45d19/0x3522fbed3b6c391b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78df3 expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.713565:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053a45d19/0x3522fbed3b6c391b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78df3 expref: 6 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.713579:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030400, rc 0) 00000100:00100000:3.0:1787384470.713638:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173891712:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 188us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.713644:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:2.0:1787384470.721964:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384470.722059:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173891968 00000100:00100000:1.0:1787384470.722068:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173891968 00000100:00100000:1.0:1787384470.722124:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:1.0:1787384470.722135:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+23:10415:x1874208173891968:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787384470.722238:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+23:10415:x1874208173891968:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 104us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.722246:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:1.0:1787384470.733469:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384470.733542:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173892096 00000100:00100000:0.0:1787384470.733551:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173892096 00000100:00100000:0.0:1787384470.733609:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:0.0:1787384470.733619:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:10415:x1874208173892096:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384470.733635:0:10631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384470.733655:0:10631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78dfa expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.733684:0:10631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053a45d19/0x3522fbed3b6c391b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78df3 expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.733692:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384470.733696:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384470.733701:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 7 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.733751:0:10631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053a45d19/0x3522fbed3b6c391b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78df3 expref: 7 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.733765:0:10631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053a45d19/0x3522fbed3b6c391b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78df3 expref: 7 pid: 6576 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384470.733781:0:10631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10631:1874208195936256:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384470.733887:0:10631:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3430c9d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384470.737281:0:10631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d2a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10631:1874208195936256:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384470.737313:0:10631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 7 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.737333:0:10631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ac00, rc 0) 00000100:00100000:0.0:1787384470.737394:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:10415:x1874208173892096:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 3775us (3930us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384470.737404:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:3.0:1787384470.739182:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384470.740140:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173892224 00000100:00100000:1.0:1787384470.740151:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173892224 00010000:00010000:1.0:1787384470.740194:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053a45d19/0x3522fbed3b6c391b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78df3 expref: 7 pid: 6576 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384470.740240:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:1.0:1787384470.740250:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173892224:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384470.740264:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384470.740285:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053a45d19/0x3522fbed3b6c391b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78df3 expref: 7 pid: 6576 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.740299:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053a45d19/0x3522fbed3b6c391b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78df3 expref: 7 pid: 6576 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.740325:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053a45d19/0x3522fbed3b6c391b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78df3 expref: 7 pid: 6576 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.740343:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384470.740347:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384470.740355:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 6 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.740365:0:7472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 6 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.740402:0:7472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 6 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384470.740427:0:7472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7472:1874208195936384:192.168.203.51@tcp:105: 00000100:00100000:1.0:1787384470.740535:0:7472:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3441b1000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384470.744813:0:7472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:7472:1874208195936384:192.168.203.51@tcp:105: 00010000:00010000:1.0:1787384470.744855:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384470.744933:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441d8450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173892224:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 4684us (5758us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.744944:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:3.0:1787384470.748742:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384470.748830:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173892352 00000100:00100000:0.0:1787384470.748846:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173892352 00002000:00100000:0.0:1787384470.748920:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff89e2410ab480 x1874208173892352/t0(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:501/0 lens 504/0 e 0 to 0 dl 1787384481 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787384470.748931:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e2410ab480 with x1874208173892352 ext(0->8) 00002000:00010000:0.0:1787384470.748936:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e2410ab480 00000100:00100000:0.0:1787384470.748960:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:0.0:1787384470.748977:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173892352:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787384470.749585:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173892352:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 Request processed in 601us (1621us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787384470.749593:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00002000:00100000:0.0:1787384470.749600:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff89e2410ab480 x1874208173892352/t4294967302(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:501/0 lens 504/448 e 0 to 0 dl 1787384481 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787384470.749608:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e2410ab480 with x1874208173892352 ext(0->8) 00002000:00010000:0.0:1787384470.749612:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e2410ab480 00000100:00100000:0.0:1787384470.755770:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384470.755902:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173892480 00000100:00100000:1.0:1787384470.755912:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173892480 00000100:00100000:1.0:1787384470.755971:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:1.0:1787384470.755980:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+23:10415:x1874208173892480:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787384470.809000:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+23:10415:x1874208173892480:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 53005us (53223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.809016:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 80 00000001:00080000:1.0:1787384470.809080:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967349 is committed 00000001:00080000:1.0:1787384470.809106:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000001:00080000:1.0:1787384470.809119:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1787384470.809130:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1787384470.809144:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000100:00100000:1.0:1787384470.809323:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195936512:0@lo:2:osp-syn-1-0.0 00000020:00080000:2.0:1787384470.809342:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787384470.809354:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787384470.809388:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384470.809442:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195936512 00000100:00100000:2.0:1787384470.809452:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195936512 00000100:00100000:2.0:1787384470.809504:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787384470.809515:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195936512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787384470.809711:0:6576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1787384470.809739:0:6576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787384469 00002000:00010000:2.0:1787384470.809742:0:6576:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787384470.809744:0:6576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787384469 -> 1787384469 00002000:00010000:2.0:1787384470.809747:0:6576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787384470.809786:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195936512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 273us (398us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787384470.809793:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:1.0:1787384470.809851:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e3779f0380/2, rc 0, transno 4294967303 00000100:00100000:1.0:1787384470.809882:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195936512:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787384470.816712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384470.816800:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173892608 00000100:00100000:1.0:1787384470.816813:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173892608 00000100:00100000:1.0:1787384470.816909:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:1.0:1787384470.816920:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173892608:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1787384470.892109:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173892608:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 75174us (75393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.892128:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 30 00000001:00080000:1.0:1787384470.892181:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00080000:1.0:1787384470.892199:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:2.0:1787384470.900043:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.900430:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173892864 00000100:00100000:3.0:1787384470.900443:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173892864 00000100:00100000:3.0:1787384470.900522:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:3.0:1787384470.900534:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+13:10415:x1874208173892864:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384470.900606:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384470.900645:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dec expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.900669:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:3.0:1787384470.900675:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384470.900717:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.900733:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.900745:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384470.901577:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000005d3734 reply state 000000007a685b4d transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384470.901594:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384470.901738:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+14:10415:x1874208173892864:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 1204us (1707us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1787384470.901747:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 81 00010000:00010000:3.0:1787384470.904834:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.904903:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.904912:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.904919:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384470.904925:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.904944:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.904968:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:3.0:1787384470.904972:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384470.904977:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.904982:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3929 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384470.906237:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.906324:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173892992 00000100:00100000:3.0:1787384470.906336:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173892992 00000100:00100000:3.0:1787384470.906450:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:3.0:1787384470.906462:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173892992:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787384470.906797:0:6574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1787384470.906801:0:6574:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787384469 -> 1787384468 00002000:00010000:3.0:1787384470.906804:0:6574:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787384467 00002000:00010000:3.0:1787384470.906806:0:6574:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787384469 -> 1787384468 00002000:00010000:3.0:1787384470.906824:0:6574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787384470.906927:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2350:x1874208173892992:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 466us (702us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1787384470.906936:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:0.0:1787384470.910375:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384470.911204:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173893248 00000100:00100000:1.0:1787384470.911218:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173893248 00000100:00100000:1.0:1787384470.911401:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:1.0:1787384470.911424:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+13:10415:x1874208173893248:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787384470.911515:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.911538:0:7691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dde expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.911547:0:7691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.911590:0:7691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dde expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.911605:0:7691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dde expref: 13 pid: 5784 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384470.911623:0:7691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195936640:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384470.911745:0:7691:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3661c4000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384470.936564:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384470.936725:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173893376 00000100:00100000:2.0:1787384470.936742:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173893376 00010000:00010000:2.0:1787384470.936815:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dde expref: 14 pid: 5784 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384470.936900:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:2.0:1787384470.936912:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+14:2353:x1874208173893376:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384470.936931:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384470.936939:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dde expref: 14 pid: 5784 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.936954:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dde expref: 14 pid: 5784 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.936987:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:2.0:1787384470.936992:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.937006:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.937024:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384470.937051:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384470.937131:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+14:2353:x1874208173893376:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 220us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384470.937142:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00010000:00010000:3.0:1787384470.938136:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c38f1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dde expref: 13 pid: 5784 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384470.938162:0:7691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1ea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195936640:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384470.938192:0:7691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.938203:0:7691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.938209:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.938251:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.938260:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.938267:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.938273:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384470.938279:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.938289:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.938315:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:3.0:1787384470.938318:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787384470.938325:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.938332:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3930 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384470.938433:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+12:10415:x1874208173893248:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 Request processed in 27012us (28071us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787384470.938444:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:3.0:1787384470.946108:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384470.946213:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173893504 00000100:00100000:0.0:1787384470.946225:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173893504 00000100:00100000:0.0:1787384470.946306:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:0.0:1787384470.946318:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173893504:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787384470.946374:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.946398:0:6575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 7 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.946419:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1787384470.946424:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384470.946430:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.946500:0:6575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 7 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.946516:0:6575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 7 pid: 10631 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384470.946535:0:6575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6575:1874208195936768:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384470.946641:0:6575:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3441b1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384470.953363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384470.953611:0:6575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d1f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6575:1874208195936768:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384470.953652:0:6575:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384470.953723:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173893632 00000100:00100000:1.0:1787384470.953732:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173893632 00010000:00010000:1.0:1787384470.953787:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 8 pid: 10631 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384470.953844:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:1.0:1787384470.953856:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173893632:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384470.953909:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384470.953939:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 8 pid: 10631 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.953956:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 8 pid: 10631 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.953988:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f90f58f/0x3522fbed3b6c3922 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dfa expref: 8 pid: 10631 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.954008:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384470.954012:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384470.954020:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.954032:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384470.954062:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384470.954129:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173893632:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 274us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384470.954152:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00010000:00010000:0.0:1787384470.954220:0:6575:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.954229:0:6575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.954268:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.954277:0:6575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.954298:0:6575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.954306:0:6575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384470.954312:0:6575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.954323:0:6575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.954339:0:6575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384470.954348:0:6575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000081bbc09d/0x3522fbed3b6c3937 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384470.954402:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173893504:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 8086us (8310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384470.954423:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:2.0:1787384470.968177:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.970194:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173893888 00000100:00100000:3.0:1787384470.970215:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173893888 00000100:00100000:3.0:1787384470.970510:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:3.0:1787384470.970523:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+12:10415:x1874208173893888:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787384470.971064:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c393e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.971089:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c393e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.971104:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c393e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.972798:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.972841:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38ff lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78de5 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.972852:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.973372:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78de5 expref: 13 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.973395:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78de5 expref: 13 pid: 5783 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384470.973423:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195936896:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384470.973556:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8780 going to sleep for 11 seconds 00000100:00100000:3.0:1787384470.976555:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410a9880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195936896:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384470.977436:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384470.977587:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384470.979489:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173894016 00000100:00100000:3.0:1787384470.979509:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173894016 00010000:00010000:3.0:1787384470.979565:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78de5 expref: 14 pid: 5783 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384470.981375:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:3.0:1787384470.981398:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+14:2353:x1874208173894016:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384470.983440:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384470.983462:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38ff lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78de5 expref: 14 pid: 5783 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.983485:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38ff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78de5 expref: 14 pid: 5783 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.983517:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c38ff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78de5 expref: 14 pid: 5783 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.983540:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:3.0:1787384470.983546:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.983558:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.983565:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.983603:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384470.983709:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+13:2353:x1874208173894016:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 2317us (6122us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.983722:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00010000:00010000:3.0:1787384470.983814:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384470.983823:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384470.987756:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000040:00080000:2.0:1787384470.987783:0:11845:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384470.987790:0:11845:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384470.987849:0:11845:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787384470.987855:0:11845:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787384470.988015:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1787384470.988070:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1787384470.989709:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e2410aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195937024:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787384470.989808:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384470.989873:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384470.990039:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195937024 00000100:00100000:3.0:1787384470.990049:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195937024 00000100:00100000:3.0:1787384470.992490:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384470.992747:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1874208195937024:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787384470.992993:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1874208195937024:12345-0@lo:1000:mdt00_002.0 Request processed in 265us (3184us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384470.993002:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384470.993042:0:5785:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1787384470.993052:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e3779f0380, transno 4294967303 00000100:00100000:2.0:1787384470.993078:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e2410aad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195937024:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1787384470.996101:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1787384470.996478:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195937152:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787384470.996574:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384470.996622:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3732f7480 going to sleep for 11 seconds 00000100:00100000:0.0:1787384470.998956:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195937152 00000100:00100000:0.0:1787384470.998978:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195937152 00000100:00100000:0.0:1787384470.999065:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384470.999078:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5785:x1874208195937152:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787384470.999533:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5785:x1874208195937152:12345-0@lo:1000:mdt00_002.0 Request processed in 455us (2956us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787384470.999559:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384471.000108:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2e0000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195937152:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1787384471.000171:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000184:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000193:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000210:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384471.000216:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000225:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000246:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:2.0:1787384471.000249:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384471.000595:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000603:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3945 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000664:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c387a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000672:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c387a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000679:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c387a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000685:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384471.000688:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c387a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000695:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c387a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.000719:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e343ce4e00) 00010000:00010000:2.0:1787384471.000722:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384471.000725:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c387a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.001541:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c387a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384471.001814:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384471.001838:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc9 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384471.001848:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384471.001918:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc9 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384471.001937:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc9 expref: 16 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384471.001956:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195937280:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384471.002084:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3441b1a80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384471.011131:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384471.011589:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195937280:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384471.011626:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384471.019538:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173894144 00000100:00100000:2.0:1787384471.019563:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173894144 00010000:00010000:2.0:1787384471.019669:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc9 expref: 17 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384471.019728:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:2.0:1787384471.019741:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+17:2353:x1874208173894144:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384471.019763:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384471.019773:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc9 expref: 17 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.019791:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc9 expref: 17 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.019822:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3896 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78dc9 expref: 17 pid: 5785 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.019849:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e343ce4e00) 00010000:00010000:2.0:1787384471.019855:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.019910:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.019918:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.019953:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384471.020033:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+16:2353:x1874208173894144:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 294us (8923us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384471.020041:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00080000:2.0:1787384471.020077:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787384471.020223:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020234:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020250:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020258:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020265:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020272:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108bc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384471.020277:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020286:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020304:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e343ce4e00) 00010000:00010000:2.0:1787384471.020308:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384471.020312:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020319:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c394c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020331:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c393e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020337:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c393e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020343:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c393e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020349:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384471.020351:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c393e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020358:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c393e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020365:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e343ce4e00) 00010000:00010000:2.0:1787384471.020368:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787384471.020370:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c393e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384471.020376:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c393e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787384471.022281:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384471.022294:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384471.022326:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787384471.022335:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787384471.022753:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+15:10415:x1874208173893888:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 52224us (54583us total) trans 4294967360 rc 0/0 00000100:00100000:2.0:1787384471.022768:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 83 00000020:00080000:2.0:1787384471.022775:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787384471.036096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384471.036196:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173894400 00000100:00100000:3.0:1787384471.036210:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173894400 00000100:00100000:3.0:1787384471.036280:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:3.0:1787384471.036292:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+15:10415:x1874208173894400:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787384471.037180:0:5786:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787384471.037295:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1787384471.037357:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037377:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037400:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037431:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037438:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037445:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037473:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787384471.037608:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+17:10415:x1874208173894400:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 1314us (1523us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1787384471.037620:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000020:00080000:3.0:1787384471.037626:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787384471.037667:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384471.037674:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037681:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384471.037686:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037695:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037709:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff89e34836ae00) 00010000:00010000:3.0:1787384471.037713:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787384471.037725:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037731:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3953 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384471.037755:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384471.037757:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384471.037759:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384471.117334:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195937408:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384471.117444:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384471.117748:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195937408 00000100:00100000:2.0:1787384471.117758:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195937408 00000100:00100000:2.0:1787384471.117813:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787384471.117821:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195937408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384471.117850:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1787384471.120058:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195937408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384471.120078:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787384471.121231:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195937408:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787384471.561282:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384472.587493:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384473.250541:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384473.250581:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384473.250619:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384473.250640:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384473.250667:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384473.250794:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173894912 00000100:00100000:3.0:1787384473.250807:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173894912 00000100:00100000:3.0:1787384473.250894:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173894784 00000100:00100000:3.0:1787384473.250898:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173894784 00000100:00100000:3.0:1787384473.250941:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:3.0:1787384473.250952:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173894912:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384473.251048:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173894912:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 98us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384473.251056:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:3.0:1787384473.251075:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:3.0:1787384473.251081:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173894784:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384473.251327:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173894656 00000100:00100000:2.0:1787384473.251333:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173894656 00000100:00100000:2.0:1787384473.251378:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173895040 00000100:00100000:2.0:1787384473.251382:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173895040 00000100:00100000:2.0:1787384473.251415:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 138 00000100:00100000:2.0:1787384473.251422:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+17:2352:x1874208173894656:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384473.251462:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+17:2352:x1874208173894656:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 40us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384473.251469:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 138 00000100:00100000:2.0:1787384473.251484:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 139 00000100:00100000:2.0:1787384473.251491:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173895040:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384473.251534:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173895040:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 44us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384473.251541:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 139 00000100:00100000:2.0:1787384473.251564:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173894528 00000100:00100000:2.0:1787384473.251568:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173894528 00000100:00100000:2.0:1787384473.251594:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 290 00000100:00100000:2.0:1787384473.251601:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173894528:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384473.251627:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173894528:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384473.251634:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 290 00000100:00100000:3.0:1787384473.251696:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173894784:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384473.251706:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00080000:3.0:1787384473.251747:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787384473.251753:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787384473.251755:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787384473.296086:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00080000:0.0:1787384473.296124:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000040:00080000:1.0:1787384473.299296:0:11900:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384473.299310:0:11900:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384473.299358:0:11900:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1787384473.299370:0:11900:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787384473.505254:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384473.511281:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173895296 00000100:00100000:0.0:1787384473.511304:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173895296 00000100:00100000:0.0:1787384473.511400:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:0.0:1787384473.511414:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+17:10434:x1874208173895296:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384473.511445:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384473.511487:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c395a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e01 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.511824:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3961 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.511842:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3961 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.511884:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3961 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384473.511898:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787384473.512127:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c395a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e01 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.512148:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3961 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e01 expref: 19 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.512158:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:0.0:1787384473.512161:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384473.512166:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b200, rc 0) 00000100:00100000:0.0:1787384473.512247:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+19:10434:x1874208173895296:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 836us (7007us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787384473.512255:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:1.0:1787384473.521206:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384473.521452:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173895424 00000100:00100000:2.0:1787384473.521467:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173895424 00000100:00100000:2.0:1787384473.521550:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 85 00000100:00100000:2.0:1787384473.521561:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+19:10434:x1874208173895424:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:2.0:1787384473.521690:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c396f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.521715:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c396f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.521733:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c396f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.521750:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3976 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.521757:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.521796:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522516:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522530:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522540:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384473.522598:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522615:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c396f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522622:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c396f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522629:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c396f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522635:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384473.522641:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c396f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522650:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c396f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522666:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:2.0:1787384473.522676:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384473.522683:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c396f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522690:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c396f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522706:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3976 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522711:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3976 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522717:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522722:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384473.522725:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3976 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522732:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3976 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522740:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e345695900) 00010000:00010000:2.0:1787384473.522743:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384473.522746:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3976 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522751:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3976 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522773:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522786:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522791:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522795:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384473.522798:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522804:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522812:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e345695e00) 00010000:00010000:2.0:1787384473.522815:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384473.522819:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.522825:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c397d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384473.525556:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+19:10434:x1874208173895424:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 3979us (4349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384473.525575:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 85 00000100:00100000:1.0:1787384473.608784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384473.614146:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173895680 00000100:00100000:0.0:1787384473.614169:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173895680 00000100:00100000:0.0:1787384473.614269:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 86 00000100:00100000:0.0:1787384473.614281:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+19:10437:x1874208173895680:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384473.614332:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384473.614360:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3984 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e08 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.614471:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c398b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.614489:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c398b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.614504:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c398b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.614522:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.614529:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.614536:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615017:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615028:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615036:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384473.615048:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787384473.615182:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c398b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615192:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c398b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615199:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c398b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615207:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384473.615212:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c398b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615221:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c398b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615236:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:0.0:1787384473.615239:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384473.615245:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c398b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615252:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c398b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615267:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615273:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3992 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615280:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615286:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384473.615295:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615302:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3992 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615311:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e357751b00) 00010000:00010000:0.0:1787384473.615313:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384473.615317:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3992 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615324:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3992 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615372:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3984 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e08 expref: 22 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615396:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e08 expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.615403:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384473.615406:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384473.615408:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b400, rc 0) 00000100:00100000:0.0:1787384473.615509:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eefb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+21:10437:x1874208173895680:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1229us (6745us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1787384473.615519:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 86 00010000:00010000:2.0:1787384473.616278:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384473.632093:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384473.632993:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173895808 00000100:00100000:0.0:1787384473.633009:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173895808 00000100:00100000:0.0:1787384473.633094:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:0.0:1787384473.633106:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+21:10437:x1874208173895808:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:0.0:1787384473.633240:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c39a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.633264:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c39a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.633280:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c39a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.633317:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c39a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.633324:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c39a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.633332:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c39a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.633338:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384473.633344:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c39a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.633353:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c39a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.633368:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384473.633372:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384473.633377:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c39a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.633384:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c39a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384473.633532:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+21:10437:x1874208173895808:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 427us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384473.633540:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:0.0:1787384473.639342:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384473.639468:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173896064 00000100:00100000:3.0:1787384473.639485:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173896064 00000100:00100000:3.0:1787384473.639561:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1787384473.639582:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350fbb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+21:10437:x1874208173896064:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1787384473.650356:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350fbb450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+22:10437:x1874208173896064:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 10760us (11013us total) trans 4294967365 rc 0/0 00000100:00100000:2.0:1787384473.650374:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:1.0:1787384473.733047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384473.733104:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173896320 00000100:00100000:1.0:1787384473.733117:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173896320 00000100:00100000:1.0:1787384473.733183:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 88 00000100:00100000:1.0:1787384473.733194:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+22:9957:x1874208173896320:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:1.0:1787384473.733226:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384473.733253:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c39ae lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e0f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384473.733410:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384473.733429:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e08 expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384473.733440:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384473.733480:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e08 expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384473.733495:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e08 expref: 23 pid: 5784 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384473.733512:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377968e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195937536:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384473.733623:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3741ddd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384473.736558:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377968e00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195937536:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384473.736596:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384473.738083:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384473.738119:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173896448 00000100:00100000:3.0:1787384473.738128:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173896448 00010000:00010000:3.0:1787384473.738171:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e08 expref: 24 pid: 5784 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384473.738208:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:3.0:1787384473.738218:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+24:2352:x1874208173896448:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384473.738234:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384473.738241:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e08 expref: 24 pid: 5784 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.738254:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e08 expref: 24 pid: 5784 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.738280:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3999 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e08 expref: 24 pid: 5784 timeout: 434 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.738297:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:3.0:1787384473.738302:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.738330:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.738338:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.738366:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384473.739009:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+23:2352:x1874208173896448:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 785us (928us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384473.739020:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 47 00010000:00010000:3.0:1787384473.739056:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.739066:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384473.739088:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1787384473.739283:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c39ae lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e0f expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.739300:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e0f expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.739307:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:3.0:1787384473.739310:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787384473.739313:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624da00, rc 0) 00000100:00100000:3.0:1787384473.739344:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+23:9957:x1874208173896320:12345-192.168.203.51@tcp:101:bash.0 Request processed in 6153us (6317us total) trans 4294967366 rc 0/0 00000100:00100000:3.0:1787384473.739352:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 88 00000100:00100000:1.0:1787384473.742529:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384473.743049:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173896704 00000100:00100000:2.0:1787384473.743063:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173896704 00000100:00100000:2.0:1787384473.743197:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:2.0:1787384473.743209:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+23:9957:x1874208173896704:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:2.0:1787384473.743560:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.743578:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.743591:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384473.743650:0:7691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1787384473.743678:0:7691:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b20f14b9 reply state 00000000c4da9614 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384473.743688:0:7691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787384473.743739:0:7691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1787384473.745297:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+27:9957:x1874208173896704:12345-192.168.203.51@tcp:36:bash.0 Request processed in 2078us (2769us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1787384473.745309:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 89 00000020:00080000:2.0:1787384473.745317:0:7691:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1787384473.749315:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:3.0:1787384473.749353:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.749366:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.749375:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.749382:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384473.749398:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.749408:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.749435:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:3.0:1787384473.749438:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384473.751778:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.751811:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c39c3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384473.758764:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173896832 00000100:00100000:3.0:1787384473.758788:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173896832 00000100:00100000:3.0:1787384473.759399:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00100000:3.0:1787384473.759414:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+26:9957:x1874208173896832:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1787384473.759563:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384473.759595:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c39ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e16 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.759754:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c39ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e16 expref: 27 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.759770:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c39ca lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e16 expref: 27 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.759793:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:3.0:1787384473.759797:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384473.759801:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030400, rc 0) 00000100:00100000:3.0:1787384473.759986:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eeb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+27:9957:x1874208173896832:12345-192.168.203.51@tcp:101:bash.0 Request processed in 575us (10685us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384473.759994:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00100000:1.0:1787384473.768761:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384473.770980:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173896960 00000100:00100000:2.0:1787384473.771000:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173896960 00000100:00100000:2.0:1787384473.771080:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:2.0:1787384473.771091:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:9957:x1874208173896960:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384473.771116:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384473.771147:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000053863fb0/0x3522fbed3b6c39d1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e1d expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384473.771204:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a895294, atime: 0x6a895293, ctime: 0x6a895294, blocks: 0xb 00010000:00010000:2.0:1787384473.771234:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=334s v=(0 0) 00010000:00010000:2.0:1787384473.771239:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384473.771249:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000053863fb0/0x3522fbed3b6c39d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e1d expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.771271:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000053863fb0/0x3522fbed3b6c39d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e1d expref: 7 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.771286:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121c00, rc 0) 00000100:00100000:2.0:1787384473.771374:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+7:9957:x1874208173896960:12345-192.168.203.51@tcp:101:bash.0 Request processed in 285us (2628us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384473.771382:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:1.0:1787384473.787075:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384473.787742:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173897088 00000100:00100000:3.0:1787384473.787756:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173897088 00002000:00010000:3.0:1787384473.787815:0:6579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787384473.787822:0:6579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e37796a680 with x1874208173897088 ext(0->18446744073709551615) 00002000:00010000:3.0:1787384473.787840:0:6579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e37796a680. 00000100:00100000:3.0:1787384473.787906:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:3.0:1787384473.787927:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173897088:12345-192.168.203.51@tcp:10:bash.0 00002000:00010000:3.0:1787384473.788308:0:6579:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1787384473.788311:0:6579:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787384468 -> 1787384472 00002000:00010000:3.0:1787384473.788314:0:6579:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787384467 -> 1787384467 00002000:00010000:3.0:1787384473.788316:0:6579:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787384468 -> 1787384472 00002000:00010000:3.0:1787384473.788318:0:6579:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1787384473.788381:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173897088:12345-192.168.203.51@tcp:10:bash.0 Request processed in 465us (1321us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787384473.788413:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00002000:00010000:3.0:1787384473.788417:0:6579:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:3.0:1787384473.788420:0:6579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e37796a680 with x1874208173897088 ext(0->18446744073709551615) 00002000:00010000:3.0:1787384473.788425:0:6579:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e37796a680. 00000100:00100000:1.0:1787384473.890085:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384473.890244:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173897216 00000100:00100000:2.0:1787384473.890258:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173897216 00000100:00100000:2.0:1787384473.890338:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 91 00000100:00100000:2.0:1787384473.890349:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+27:10451:x1874208173897216:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:2.0:1787384473.890459:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c39d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.890484:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c39d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.890499:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c39d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.890541:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c39df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.890548:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c39df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.890555:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c39df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.890968:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.890979:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.890986:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384473.891035:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891048:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c39d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891054:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c39d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891062:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c39d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891069:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384473.891074:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c39d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891089:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c39d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891105:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:2.0:1787384473.891108:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384473.891115:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c39d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891120:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c39d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891134:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c39df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891140:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c39df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891146:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c39df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891152:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384473.891155:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c39df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891161:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c39df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891169:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e345695d00) 00010000:00010000:2.0:1787384473.891172:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384473.891175:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c39df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891191:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c39df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891212:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891218:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891224:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891229:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384473.891232:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891238:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891245:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:2.0:1787384473.891247:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384473.891250:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.891256:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c39e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384473.891347:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+27:10451:x1874208173897216:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 998us (1274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384473.891356:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 91 00000100:00100000:1.0:1787384473.929259:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384473.929528:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173897472 00000100:00100000:3.0:1787384473.929544:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173897472 00000100:00100000:3.0:1787384473.929625:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 92 00000100:00100000:3.0:1787384473.929635:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+27:10454:x1874208173897472:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384473.929661:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384473.929690:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c39ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e24 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.929803:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c39f4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.929822:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c39f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.929837:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c39f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.929856:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c39fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.929899:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c39fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.929907:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c39fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.930801:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3a02 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.930815:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.930824:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3a02 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384473.930836:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1787384473.932571:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c39f4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932595:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c39f4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932604:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c39f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932611:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384473.932617:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c39f4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932627:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c39f4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932653:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384473.932657:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384473.932664:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c39f4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932702:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c39f4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932727:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c39fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932733:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c39fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932738:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c39fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932742:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384473.932745:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c39fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932751:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c39fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932760:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e34836ac00) 00010000:00010000:3.0:1787384473.932763:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384473.932766:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c39fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.932772:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c39fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.934927:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c39ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e24 expref: 30 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.934971:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3a02 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e24 expref: 29 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384473.935200:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:3.0:1787384473.935203:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787384473.935207:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030200, rc 0) 00000100:00100000:3.0:1787384473.935322:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+29:10454:x1874208173897472:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 5686us (6336us total) trans 4294967370 rc 0/0 00000100:00100000:3.0:1787384473.935334:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 92 00000100:00100000:1.0:1787384473.939546:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384473.944021:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173897600 00000100:00100000:2.0:1787384473.944046:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173897600 00000100:00100000:2.0:1787384473.944139:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 93 00000100:00100000:2.0:1787384473.944151:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+29:10454:x1874208173897600:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:2.0:1787384473.944258:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.944279:0:7691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e0f expref: 29 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.944289:0:7691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.944337:0:7691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e0f expref: 29 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.944355:0:7691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e0f expref: 29 pid: 5784 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384473.944373:0:7691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195937664:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384473.944718:0:7691:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e341254a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384473.959951:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384473.961178:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173897856 00000100:00100000:0.0:1787384473.961198:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173897856 00000100:00100000:0.0:1787384473.961295:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:0.0:1787384473.961308:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+30:5566:x1874208173897856:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000001:00080000:0.0:1787384473.961688:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967371 00000100:00100000:0.0:1787384473.962049:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+32:5566:x1874208173897856:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 741us (2109us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1787384473.962059:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000020:00080000:0.0:1787384473.962066:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787384473.963033:0:7691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2e0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195937664:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384473.963069:0:7691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384473.969478:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384473.974427:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173897984 00000100:00100000:2.0:1787384473.974453:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173897984 00010000:00010000:2.0:1787384473.974611:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e0f expref: 32 pid: 5784 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384473.974703:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:2.0:1787384473.974716:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+32:2353:x1874208173897984:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384473.974739:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384473.974748:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e0f expref: 32 pid: 5784 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.974764:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e0f expref: 32 pid: 5784 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.976230:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c39b5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e0f expref: 32 pid: 5784 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.976270:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:2.0:1787384473.976277:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.976288:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.976297:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384473.976350:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384473.976454:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+31:2353:x1874208173897984:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 1739us (6992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384473.976467:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00010000:00010000:0.0:1787384473.976632:0:7691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.976643:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.976704:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.976713:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.976721:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.976754:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384473.976761:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.976770:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.979333:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384473.979339:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384473.979348:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384473.979360:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384473.979505:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+30:10454:x1874208173897600:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 35347us (39966us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384473.979518:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 93 00000100:00100000:1.0:1787384473.986339:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384473.991331:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173898240 00000100:00100000:0.0:1787384473.991354:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173898240 00000100:00100000:0.0:1787384473.991459:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:0.0:1787384473.991473:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+30:10454:x1874208173898240:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1787384473.993398:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+31:10454:x1874208173898240:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 1904us (7054us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1787384473.993417:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:1.0:1787384474.134788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384474.135284:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173898496 00000100:00100000:2.0:1787384474.135317:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173898496 00000100:00100000:2.0:1787384474.135403:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 94 00000100:00100000:2.0:1787384474.135415:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+31:10465:x1874208173898496:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:2.0:1787384474.135452:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384474.135479:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e2b expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.135577:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a1e lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.135594:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.135608:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.135625:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.135632:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.135638:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.136698:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3a2c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.136714:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.136724:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3a2c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384474.136746:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:2.0:1787384474.136934:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a1e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.136944:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a1e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137394:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137405:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384474.137410:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a1e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137419:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a1e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137436:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:2.0:1787384474.137439:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384474.137446:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a1e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137453:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a1e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137470:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137476:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a25 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137496:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137511:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384474.137514:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137521:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a25 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137530:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e345695d00) 00010000:00010000:2.0:1787384474.137533:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384474.137536:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a25 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137542:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137623:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e2b expref: 34 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137638:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3a2c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e2b expref: 33 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.137646:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:2.0:1787384474.137648:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384474.137651:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120400, rc 0) 00000100:00100000:2.0:1787384474.137755:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+33:10465:x1874208173898496:12345-192.168.203.51@tcp:101:cat.0 Request processed in 2342us (2994us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1787384474.137774:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 94 00000100:00100000:1.0:1787384474.146891:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384474.151642:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173898752 00000100:00100000:3.0:1787384474.151664:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173898752 00000100:00100000:3.0:1787384474.153204:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:3.0:1787384474.153230:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+33:10465:x1874208173898752:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:3.0:1787384474.153606:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+34:10465:x1874208173898752:12345-192.168.203.51@tcp:35:cat.0 Request processed in 388us (6753us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1787384474.153615:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:1.0:1787384474.202465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384474.202936:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173899008 00000100:00100000:0.0:1787384474.202960:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173899008 00000100:00100000:0.0:1787384474.203046:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 95 00000100:00100000:0.0:1787384474.203075:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+34:10466:x1874208173899008:12345-192.168.203.51@tcp:36:rm.0 00010000:00010000:0.0:1787384474.203167:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787384474.203205:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3a2c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e2b expref: 34 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203231:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3a02 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e24 expref: 33 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203246:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c39ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e16 expref: 32 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203257:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384474.203271:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384474.203302:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a3a lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203318:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203330:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203346:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203353:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203359:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203761:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a48 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203772:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.203779:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384474.204591:0:5785:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787384474.204605:0:5785:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335347744316ns, next at 336347740714ns, rc = 0 00010000:00010000:0.0:1787384474.204699:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204713:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204722:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204730:0:5785:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204737:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204743:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204766:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384474.204793:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a48 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204809:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a48 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204816:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204822:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384474.204827:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a48 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204836:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a48 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204849:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751d00) 00010000:00010000:0.0:1787384474.204852:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787384474.204898:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a48 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204906:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a48 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204927:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a3a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204934:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a3a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204941:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204946:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ac00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384474.204955:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a3a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204962:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a3a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204972:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:0.0:1787384474.204974:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384474.204978:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a3a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.204984:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a3a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384474.204995:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006e912d12 reply state 00000000fd8504b2 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384474.205006:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384474.205127:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+33:10466:x1874208173899008:12345-192.168.203.51@tcp:36:rm.0 Request processed in 2049us (2680us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1787384474.205137:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 95 00010000:00010000:1.0:1787384474.205237:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384474.205245:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.205253:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384474.205256:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.205264:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.205275:0:5772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff89e357751d00) 00010000:00010000:1.0:1787384474.205278:0:5772:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787384474.205280:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.205286:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3a4f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.205303:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384474.205305:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384474.205307:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384474.207782:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.207805:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.207813:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.207819:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384474.207824:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.207832:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.207906:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e357751b00) 00010000:00010000:3.0:1787384474.207910:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384474.207915:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.207930:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3a41 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384474.271151:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384474.271267:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173899264 00000100:00100000:3.0:1787384474.271283:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173899264 00000100:00100000:3.0:1787384474.271363:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 96 00000100:00100000:3.0:1787384474.271376:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+32:10472:x1874208173899264:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1787384474.271421:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384474.271460:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3a56 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e32 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.272230:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a5d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.272254:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.272270:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.272288:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.272296:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.272303:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384474.273123:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1787384474.273346:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273359:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273368:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273422:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a5d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273442:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a5d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273450:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273456:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384474.273462:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a5d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273471:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a5d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273485:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:2.0:1787384474.273488:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384474.273494:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273500:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384474.273515:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000009464d0b reply state 0000000062f803d0 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384474.273525:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787384474.273569:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3a56 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e32 expref: 35 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273587:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e32 expref: 34 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.273611:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e345695a00) 00010000:00010000:2.0:1787384474.273613:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384474.273616:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121400, rc 0) 00000100:00100000:2.0:1787384474.274361:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+35:10472:x1874208173899264:12345-192.168.203.51@tcp:101:bash.0 Request processed in 2979us (3216us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1787384474.274374:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 96 00000100:00100000:1.0:1787384474.282762:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384474.283373:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173899392 00000100:00100000:0.0:1787384474.283396:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173899392 00000100:00100000:0.0:1787384474.283481:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:0.0:1787384474.283493:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173899392:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1787384474.283521:0:6575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384474.283548:0:6575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3a79 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e39 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384474.283582:0:6575:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787384474.283627:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:0.0:1787384474.283633:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384474.283647:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3a79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e39 expref: 6 pid: 6575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.283671:0:6575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3a79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e39 expref: 6 pid: 6575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.283686:0:6575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ac00, rc 0) 00000100:00100000:0.0:1787384474.283776:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173899392:12345-192.168.203.51@tcp:101:bash.0 Request processed in 284us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384474.283784:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00010000:00010000:3.0:1787384474.284821:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.284839:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.284847:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.284854:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384474.284909:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.284949:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.285250:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e345695d00) 00010000:00010000:3.0:1787384474.285254:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384474.285260:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.285267:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3a64 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384474.291187:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384474.291394:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173899520 00000100:00100000:3.0:1787384474.291408:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173899520 00000100:00100000:3.0:1787384474.291476:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:3.0:1787384474.291489:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:10472:x1874208173899520:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1787384474.291644:0:10631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384474.291672:0:10631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e40 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.291714:0:10631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3a79 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e39 expref: 7 pid: 6575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.291724:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384474.291728:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384474.291734:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 7 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.291776:0:10631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3a79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e39 expref: 7 pid: 6575 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.291812:0:10631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3a79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e39 expref: 7 pid: 6575 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384474.291830:0:10631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379ee9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10631:1874208195937792:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384474.292728:0:10631:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410fd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384474.297791:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384474.297945:0:10631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379ee9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10631:1874208195937792:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384474.298002:0:10631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 7 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.298030:0:10631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030000, rc 0) 00000100:00100000:3.0:1787384474.298115:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:10472:x1874208173899520:12345-192.168.203.51@tcp:101:bash.0 Request processed in 6628us (6943us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384474.298126:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:0.0:1787384474.310125:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173899648 00000100:00100000:0.0:1787384474.310148:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173899648 00010000:00010000:0.0:1787384474.310219:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3a79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e39 expref: 7 pid: 6575 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384474.310279:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:0.0:1787384474.310290:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173899648:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384474.310309:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384474.310339:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3a79 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e39 expref: 7 pid: 6575 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.310354:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3a79 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e39 expref: 7 pid: 6575 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.310420:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3a79 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e39 expref: 7 pid: 6575 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.310442:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384474.310447:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384474.310456:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 6 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.310468:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 6 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.310518:0:5769:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 6 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384474.310536:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5769:1874208195937920:192.168.203.51@tcp:105: 00000100:00100000:0.0:1787384474.310654:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384474.314606:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384474.315228:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173899904 00000100:00100000:1.0:1787384474.315244:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173899904 00000100:00100000:1.0:1787384474.315319:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:1.0:1787384474.315331:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+34:10472:x1874208173899904:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:1.0:1787384474.315805:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+35:10472:x1874208173899904:12345-192.168.203.51@tcp:35:bash.0 Request processed in 474us (1216us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787384474.315832:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:0.0:1787384474.317050:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d0e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5769:1874208195937920:192.168.203.51@tcp:105: 00010000:00010000:0.0:1787384474.317092:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384474.317158:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441db050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173899648:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 6868us (19380us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384474.317170:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:2.0:1787384474.587562:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384474.587681:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173900032 00000100:00100000:0.0:1787384474.587695:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173900032 00000100:00100000:0.0:1787384474.587770:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:0.0:1787384474.587800:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+35:10488:x1874208173900032:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384474.587832:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384474.587921:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e47 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.588016:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a8e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.588032:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.588047:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384474.588140:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1787384474.588145:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384474.588173:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a8e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.588203:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3a87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e47 expref: 37 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.588227:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a8e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e47 expref: 36 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.588237:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:0.0:1787384474.588240:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384474.588246:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a600, rc 0) 00000100:00100000:0.0:1787384474.588341:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+36:10488:x1874208173900032:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 543us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384474.588362:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:1.0:1787384474.596643:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384474.596757:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173900288 00000100:00100000:2.0:1787384474.596772:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173900288 00000100:00100000:2.0:1787384474.596899:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:2.0:1787384474.596925:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+36:10488:x1874208173900288:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384474.596955:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384474.596983:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3a95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e4e expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.597312:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.597330:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.597345:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384474.597360:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1787384474.597572:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3a95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e4e expref: 39 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.597594:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e4e expref: 38 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.597605:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e345695a00) 00010000:00010000:2.0:1787384474.597608:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384474.597613:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120600, rc 0) 00000100:00100000:2.0:1787384474.597761:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+38:10488:x1874208173900288:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 850us (1131us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1787384474.597771:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:1.0:1787384474.605980:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384474.606023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384474.606213:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173900544 00000100:00100000:0.0:1787384474.606225:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173900544 00000100:00100000:0.0:1787384474.606305:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00100000:0.0:1787384474.606318:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+38:10488:x1874208173900544:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384474.606350:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384474.606376:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3aaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e55 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.606535:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ab1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.606554:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.606570:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ab1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384474.606584:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787384474.606748:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3aaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e55 expref: 41 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.606770:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ab1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e55 expref: 40 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.606780:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e345695a00) 00010000:00010000:0.0:1787384474.606783:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787384474.606787:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a400, rc 0) 00000100:00100000:0.0:1787384474.607047:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+40:10488:x1874208173900544:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 730us (1081us total) trans 4294967380 rc 0/0 00000100:00100000:0.0:1787384474.607055:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00100000:2.0:1787384474.607181:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173900672 00000100:00100000:2.0:1787384474.607188:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173900672 00000100:00100000:2.0:1787384474.607232:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:2.0:1787384474.607241:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+40:2353:x1874208173900672:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384474.607255:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384474.607274:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3a9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e4e expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.607289:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e345695a00) 00010000:00010000:2.0:1787384474.607293:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384474.607316:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+39:2353:x1874208173900672:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 77us (1293us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384474.607323:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1787384474.612691:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384474.612781:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173900800 00000100:00100000:0.0:1787384474.612796:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173900800 00000100:00100000:0.0:1787384474.612933:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:0.0:1787384474.612946:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173900800:12345-192.168.203.51@tcp:1:lfs.0 00010000:00010000:0.0:1787384474.613012:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.613041:0:6575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 6 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.613051:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384474.613056:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384474.613062:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.613118:0:6575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 6 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.613136:0:6575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 6 pid: 10631 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384474.613154:0:6575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6575:1874208195938048:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384474.613275:0:6575:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384474.617743:0:6575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6575:1874208195938048:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384474.617788:0:6575:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384474.618544:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384474.619203:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173900928 00000100:00100000:3.0:1787384474.619216:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173900928 00002000:00100000:3.0:1787384474.619283:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff89e379fc9880 x1874208173900928/t0(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:505/0 lens 504/0 e 0 to 0 dl 1787384485 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384474.619294:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e379fc9880 with x1874208173900928 ext(0->8) 00010000:00010000:3.0:1787384474.619303:0:6580:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 7 pid: 10631 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.619323:0:6580:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 7 pid: 10631 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384474.619355:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89e379fc9880 00000100:00100000:3.0:1787384474.619405:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:3.0:1787384474.619417:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173900928:12345-192.168.203.51@tcp:4:lfs.0 00000100:00100000:3.0:1787384474.620606:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddc9253f-47aa-4509-981d-645f91ec7250+9:2352:x1874208173900928:12345-192.168.203.51@tcp:4:lfs.0 Request processed in 1182us (2055us total) trans 4294967302 rc 0/0 00000100:00100000:3.0:1787384474.620620:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00002000:00100000:3.0:1787384474.620631:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff89e379fc9880 x1874208173900928/t4294967302(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:505/0 lens 504/448 e 0 to 0 dl 1787384485 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384474.620641:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e379fc9880 with x1874208173900928 ext(0->8) 00010000:00010000:3.0:1787384474.620650:0:6580:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 9 pid: 10631 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.620670:0:6580:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 9 pid: 10631 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384474.620678:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89e379fc9880 00000100:00100000:1.0:1787384474.624472:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384474.624631:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173901056 00000100:00100000:3.0:1787384474.624647:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173901056 00010000:00010000:3.0:1787384474.624700:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 9 pid: 10631 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384474.624749:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1787384474.624759:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:2353:x1874208173901056:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384474.624796:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787384474.624822:0:5770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787384474.624825:0:5770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787384473 00002000:00010000:3.0:1787384474.624827:0:5770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787384473 00002000:00010000:3.0:1787384474.624830:0:5770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787384473 00010000:00010000:3.0:1787384474.624837:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 9 pid: 10631 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.624853:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 9 pid: 10631 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.625094:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c594446c/0x3522fbed3b6c3a80 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e40 expref: 9 pid: 10631 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.625176:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384474.625181:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384474.625188:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.625200:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384474.625681:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384474.625758:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173901056:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 998us (1299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384474.625780:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00010000:00010000:0.0:1787384474.627290:0:6575:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.627313:0:6575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.627358:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.627368:0:6575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.627388:0:6575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.627396:0:6575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ac00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384474.627401:0:6575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.629052:0:6575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.629194:0:6575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.629204:0:6575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c3abf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384474.629358:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2350:x1874208173900800:12345-192.168.203.51@tcp:1:lfs.0 Request processed in 16407us (16676us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384474.629371:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:2.0:1787384474.633702:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384474.633908:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173901312 00000100:00100000:0.0:1787384474.633995:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173901312 00000100:00100000:0.0:1787384474.634062:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:0.0:1787384474.634073:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350fb9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+39:10488:x1874208173901312:12345-192.168.203.51@tcp:35:lfs.0 00000004:00010000:0.0:1787384474.634262:0:5787:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ab1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e55 expref: 39 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384474.636067:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787384474.636410:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1787384474.637004:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:0.0:1787384474.637085:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.637183:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e32 expref: 43 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.637193:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.637261:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e32 expref: 43 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.637282:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e32 expref: 43 pid: 5783 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384474.637301:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1874208195938176:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384474.637431:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4c00 going to sleep for 11 seconds 00010000:00010000:2.0:1787384474.640215:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384474.640898:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384474.641406:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173901440 00000100:00100000:1.0:1787384474.641419:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173901440 00010000:00010000:1.0:1787384474.641476:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e32 expref: 44 pid: 5783 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384474.641536:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:1.0:1787384474.641548:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+44:2353:x1874208173901440:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384474.641566:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384474.641574:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e32 expref: 44 pid: 5783 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.641589:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e32 expref: 44 pid: 5783 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.641621:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e345695a00) 00010000:00010000:1.0:1787384474.641628:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.641639:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.641670:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.641696:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384474.641790:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+44:2353:x1874208173901440:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 242us (941us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384474.641799:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00010000:00010000:0.0:1787384474.643076:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3a6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e32 expref: 43 pid: 5783 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384474.643174:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d2d80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1874208195938176:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384474.643214:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.643316:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384474.643325:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384474.643637:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1787384474.644342:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1787384474.644580:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fcb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195938304:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787384474.644676:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384474.644722:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e341377600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384474.644918:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195938304 00000100:00100000:2.0:1787384474.644928:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195938304 00000100:00100000:2.0:1787384474.645018:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384474.645029:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1874208195938304:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787384474.645279:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1874208195938304:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 250us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384474.645289:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787384474.645450:0:5787:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1787384474.645457:0:5787:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1787384474.645485:0:5787:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e3733d3480, transno 4294967301 00000100:00100000:1.0:1787384474.645501:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fcb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195938304:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1787384474.647645:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787384474.647719:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1787384474.647836:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fcb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195938432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787384474.650757:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384474.650802:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3741dd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384474.651085:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195938432 00000100:00100000:2.0:1787384474.651107:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195938432 00000100:00100000:2.0:1787384474.651181:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384474.651191:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5787:x1874208195938432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787384474.651519:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5787:x1874208195938432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 328us (771us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1787384474.651528:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384474.651694:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fcb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195938432:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787384474.651794:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787384474.651900:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.651923:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.651932:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.651964:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108bc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384474.651970:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.651978:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.652001:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e345695a00) 00010000:00010000:0.0:1787384474.652004:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787384474.652009:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.652015:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ac6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384474.652259:0:5787:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787384474.652369:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787384474.652391:0:5787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335795530392ns, next at 336795527425ns, rc = 0 00000001:00080000:0.0:1787384474.652399:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:0.0:1787384474.652438:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e345695a00) 00010000:00010000:0.0:1787384474.652442:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787384474.652450:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ab1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e55 expref: 47 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384474.652572:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350fb9850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+46:10488:x1874208173901312:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 18500us (18891us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1787384474.652583:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000020:00080000:0.0:1787384474.652588:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787384474.656473:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384474.656657:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173901568 00000100:00100000:0.0:1787384474.656670:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173901568 00000100:00100000:0.0:1787384474.656781:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 100 00000100:00100000:0.0:1787384474.656795:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+46:10488:x1874208173901568:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384474.656831:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384474.657044:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3acd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e5c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.657140:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3acd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e5c expref: 47 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.657158:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3acd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e5c expref: 47 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.657180:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384474.657183:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384474.657187:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ac00, rc 0) 00000100:00100000:0.0:1787384474.657309:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+47:10488:x1874208173901568:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 517us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384474.657317:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 100 00000100:00100000:2.0:1787384474.661812:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384474.661909:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173901824 00000100:00100000:3.0:1787384474.661935:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173901824 00000100:00100000:3.0:1787384474.662013:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:3.0:1787384474.662026:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+47:10488:x1874208173901824:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1787384474.662387:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+48:10488:x1874208173901824:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 353us (580us total) trans 4294967390 rc 0/0 00000100:00100000:3.0:1787384474.662396:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:3.0:1787384474.790004:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384474.790236:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173901952 00000100:00100000:0.0:1787384474.790250:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173901952 00000100:00100000:0.0:1787384474.790332:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 101 00000100:00100000:0.0:1787384474.790345:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+48:10498:x1874208173901952:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:0.0:1787384474.790458:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ad4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790479:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790523:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790541:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3adb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790548:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790555:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790685:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790694:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790701:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384474.790753:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790768:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ad4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790774:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ad4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790782:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790797:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384474.790801:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ad4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790809:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ad4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790823:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:0.0:1787384474.790827:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384474.790832:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ad4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790838:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ad4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790853:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3adb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790923:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3adb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790930:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790936:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108bc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384474.790939:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3adb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790949:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3adb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790969:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e357751200) 00010000:00010000:0.0:1787384474.790971:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384474.790974:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3adb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790981:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3adb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.790997:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.791003:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.791008:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.791013:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384474.791016:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.791022:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.791029:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384474.791031:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384474.791034:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.791040:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ae2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384474.791150:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+48:10498:x1874208173901952:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 806us (1160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384474.791159:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 101 00000100:00100000:2.0:1787384474.829989:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384474.830153:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173902208 00000100:00100000:3.0:1787384474.830167:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173902208 00000100:00100000:3.0:1787384474.830288:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 102 00000100:00100000:3.0:1787384474.830300:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+48:10501:x1874208173902208:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384474.830328:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384474.830356:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3ae9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e63 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.830589:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3af0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.830608:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3af0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.830621:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3af0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.830640:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3af7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.830648:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.830655:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831213:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3afe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831353:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831364:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3afe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384474.831377:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787384474.831665:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3af0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831674:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3af0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831681:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3af0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831687:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384474.831693:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3af0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831701:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3af0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831717:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384474.831720:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384474.831726:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3af0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831751:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3af0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831770:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3af7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831776:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3af7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831782:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831787:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384474.831790:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3af7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831796:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3af7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831804:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e34836ac00) 00010000:00010000:3.0:1787384474.831807:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384474.831809:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3af7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.831815:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3af7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.832005:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3ae9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e63 expref: 51 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.832022:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3afe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e63 expref: 50 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384474.832035:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:3.0:1787384474.832037:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384474.832040:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030400, rc 0) 00000100:00100000:3.0:1787384474.832199:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+50:10501:x1874208173902208:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1899us (2222us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1787384474.832210:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 102 00000100:00100000:2.0:1787384474.850589:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384474.850899:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173902336 00000100:00100000:0.0:1787384474.850983:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173902336 00000100:00100000:0.0:1787384474.851076:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 103 00000100:00100000:0.0:1787384474.851089:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+50:10501:x1874208173902336:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:0.0:1787384474.851203:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.851401:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.851418:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.851457:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.851464:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.851472:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.851478:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384474.851483:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.851492:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.851532:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384474.851536:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384474.851542:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384474.851548:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384474.851774:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+50:10501:x1874208173902336:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 685us (1200us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384474.851783:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 103 00000100:00100000:2.0:1787384474.863288:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384474.863376:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173902592 00000100:00100000:3.0:1787384474.863400:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173902592 00000100:00100000:3.0:1787384474.863473:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:3.0:1787384474.863485:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+50:10501:x1874208173902592:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1787384474.863804:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+51:10501:x1874208173902592:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 319us (528us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787384474.863813:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:2.0:1787384475.016790:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384475.017596:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173902848 00000100:00100000:0.0:1787384475.017613:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173902848 00000100:00100000:0.0:1787384475.017717:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 104 00000100:00100000:0.0:1787384475.017728:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+51:10511:x1874208173902848:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1787384475.017757:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384475.017761:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787384475.017811:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3a8e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e47 expref: 51 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.017831:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:0.0:1787384475.017837:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384475.017854:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b13 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e6a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.018099:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3b1a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.018136:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.018147:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3b1a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384475.018161:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787384475.018321:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b13 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e6a expref: 53 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.018335:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3b1a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e6a expref: 52 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.018343:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384475.018345:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384475.018348:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108bc00, rc 0) 00000100:00100000:0.0:1787384475.018434:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+52:10511:x1874208173902848:12345-192.168.203.51@tcp:101:bash.0 Request processed in 707us (1657us total) trans 4294967393 rc 0/0 00000100:00100000:0.0:1787384475.018442:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 104 00000100:00080000:3.0:1787384475.018617:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384475.028948:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384475.029046:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173903104 00000100:00100000:3.0:1787384475.029060:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173903104 00000100:00100000:3.0:1787384475.029143:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 105 00000100:00100000:3.0:1787384475.029156:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+52:10511:x1874208173903104:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:3.0:1787384475.029236:0:7691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1787384475.029274:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3b1a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e6a expref: 52 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.029301:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3afe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e63 expref: 51 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.029337:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:3.0:1787384475.029344:0:7691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384475.029644:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.029660:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.029670:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384475.029729:0:7691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1787384475.029755:0:7691:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000adfa70fd reply state 00000000f67523dc transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384475.029766:0:7691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384475.029938:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+53:10511:x1874208173903104:12345-192.168.203.51@tcp:36:bash.0 Request processed in 782us (1004us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1787384475.029946:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 105 00000020:00080000:3.0:1787384475.029952:0:7691:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787384475.034633:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.034658:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.034666:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.034673:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384475.034699:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.034708:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.034731:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:3.0:1787384475.034735:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384475.034740:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.034747:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384475.036017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384475.042167:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173903232 00000100:00100000:0.0:1787384475.042190:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173903232 00000100:00100000:0.0:1787384475.042354:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 106 00000100:00100000:0.0:1787384475.042367:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+52:10511:x1874208173903232:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1787384475.042415:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384475.042445:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b2f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e71 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.042588:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.042607:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.042620:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384475.042656:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1787384475.042661:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384475.042683:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.042712:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b2f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e71 expref: 54 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.042735:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e71 expref: 53 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.042745:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384475.042749:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384475.042753:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a600, rc 0) 00000100:00100000:0.0:1787384475.042848:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+53:10511:x1874208173903232:12345-192.168.203.51@tcp:101:bash.0 Request processed in 484us (6842us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384475.042856:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 106 00000100:00100000:3.0:1787384475.049431:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384475.049594:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173903488 00000100:00100000:1.0:1787384475.049628:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173903488 00000100:00100000:1.0:1787384475.049701:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:1.0:1787384475.049713:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+53:10511:x1874208173903488:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:1.0:1787384475.050078:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+54:10511:x1874208173903488:12345-192.168.203.51@tcp:35:bash.0 Request processed in 365us (664us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787384475.050086:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:1.0:1787384475.175187:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384475.175296:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173903616 00000100:00100000:3.0:1787384475.175309:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173903616 00000100:00100000:3.0:1787384475.175399:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 107 00000100:00100000:3.0:1787384475.175412:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+54:10517:x1874208173903616:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384475.175443:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384475.175471:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b3d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e78 expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.175556:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3b44 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.175573:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.175587:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384475.175692:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787384475.175697:0:7691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384475.175722:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3b44 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.175755:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c3b3d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e78 expref: 56 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.175779:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3b44 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e78 expref: 55 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.175789:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384475.175793:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384475.175798:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030400, rc 0) 00000100:00100000:3.0:1787384475.175952:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+55:10517:x1874208173903616:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 542us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384475.175960:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 107 00000100:00100000:2.0:1787384475.179365:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384475.179472:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173903744 00000100:00100000:3.0:1787384475.179486:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173903744 00000100:00100000:3.0:1787384475.179570:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 108 00000100:00100000:3.0:1787384475.179582:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e2410aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+55:10517:x1874208173903744:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384475.179611:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384475.179638:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3b4b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e7f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.179732:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3b52 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.179769:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.179783:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.179800:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3b59 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.179807:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.179812:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.179989:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3b60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.179998:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180006:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384475.180053:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787384475.180058:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384475.180080:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180095:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3b60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180116:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3b52 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180124:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3b52 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180131:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180138:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384475.180144:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3b52 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180152:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3b52 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180168:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384475.180171:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384475.180176:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3b52 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180182:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c3b52 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180197:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3b59 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180203:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3b59 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180208:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180240:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384475.180243:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3b59 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180248:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3b59 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180256:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e34836ac00) 00010000:00010000:3.0:1787384475.180258:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384475.180260:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3b59 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180265:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c3b59 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180306:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c3b4b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e7f expref: 57 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180320:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3b60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e7f expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.180328:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:3.0:1787384475.180331:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384475.180334:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fce00, rc 0) 00000100:00100000:3.0:1787384475.180432:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e2410aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+56:10517:x1874208173903744:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 851us (1083us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384475.180440:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 108 00000100:00100000:2.0:1787384475.203265:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384475.203385:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173903872 00000100:00100000:0.0:1787384475.203399:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173903872 00000100:00100000:0.0:1787384475.203491:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1787384475.203514:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+56:2352:x1874208173903872:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384475.203536:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384475.203571:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3b60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e7f expref: 56 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.203598:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384475.203605:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384475.203681:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+55:2352:x1874208173903872:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 181us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384475.203690:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:3.0:1787384475.204055:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384475.204529:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173904128 00000100:00100000:0.0:1787384475.204537:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173904128 00000100:00100000:0.0:1787384475.204578:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 109 00000100:00100000:0.0:1787384475.204585:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+55:10517:x1874208173904128:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384475.204610:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384475.204634:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b67 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e86 expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.204780:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.204799:0:7691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e71 expref: 56 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.204809:0:7691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.204900:0:7691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e71 expref: 56 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.204925:0:7691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e71 expref: 56 pid: 5783 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384475.204942:0:7691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195938560:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384475.205043:0:7691:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384475.211391:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195938688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384475.211519:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384475.212078:0:7691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d2d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195938560:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384475.212123:0:7691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384475.212283:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195938688 00000100:00100000:3.0:1787384475.212292:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195938688 00000100:00100000:3.0:1787384475.212359:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787384475.212370:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874208195938688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384475.212411:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384475.212475:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874208195938688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (957us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384475.212482:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787384475.214063:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384475.214182:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173904256 00000100:00100000:1.0:1787384475.214194:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173904256 00010000:00010000:1.0:1787384475.214239:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e71 expref: 57 pid: 5783 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384475.214283:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:1.0:1787384475.214294:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+57:2352:x1874208173904256:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384475.214311:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384475.214319:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e71 expref: 57 pid: 5783 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384475.214333:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e71 expref: 57 pid: 5783 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384475.214361:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3b36 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e71 expref: 57 pid: 5783 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384475.214391:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:1.0:1787384475.214398:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384475.214433:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384475.214442:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384475.214473:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384475.214554:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eebb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+56:2352:x1874208173904256:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 261us (503us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384475.214562:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:0.0:1787384475.215301:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379ee9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195938688:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787384475.215343:0:7691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.215353:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384475.215386:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787384475.215605:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3b67 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e86 expref: 57 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.215625:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e86 expref: 56 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.215646:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384475.215650:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384475.215653:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a400, rc 0) 00000100:00100000:0.0:1787384475.215714:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+56:10517:x1874208173904128:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 11128us (11658us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1787384475.215723:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 109 00000100:00100000:3.0:1787384475.219250:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384475.219438:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173904512 00000100:00100000:0.0:1787384475.219452:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173904512 00000100:00100000:0.0:1787384475.219677:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1787384475.219689:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+56:10517:x1874208173904512:12345-192.168.203.51@tcp:103:lfs.0 00010000:00010000:0.0:1787384475.219711:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384475.219745:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3acd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e5c expref: 56 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384475.219766:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384475.219772:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384475.219850:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+55:10517:x1874208173904512:12345-192.168.203.51@tcp:103:lfs.0 Request processed in 163us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384475.219897:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:2.0:1787384475.227326:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384475.227440:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173904640 00000100:00100000:3.0:1787384475.227454:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173904640 00000100:00100000:3.0:1787384475.227675:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 110 00000100:00100000:3.0:1787384475.227688:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+55:10517:x1874208173904640:12345-192.168.203.51@tcp:58:lfs.0 00010000:00010000:3.0:1787384475.227893:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.227924:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384475.227940:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384475.228226:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1787384475.228363:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+55:10517:x1874208173904640:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 677us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384475.228373:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 110 00000100:00100000:1.0:1787384475.235478:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384475.235578:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173904768 00000100:00100000:2.0:1787384475.235592:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173904768 00000100:00100000:2.0:1787384475.235693:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 111 00000100:00100000:2.0:1787384475.235706:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+55:10517:x1874208173904768:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384475.235733:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384475.235761:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3b83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e8d expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384475.235837:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384475.235850:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3b83 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e8d expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384475.235899:0:5785:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384475.235926:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3b83 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e8d expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384475.235943:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:2.0:1787384475.235946:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384475.235950:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3b83 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e8d expref: 56 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384475.235959:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120600, rc 0) 00000100:00100000:2.0:1787384475.236059:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+56:10517:x1874208173904768:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 356us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384475.236068:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 111 00010000:00010000:1.0:1787384475.658349:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384475.724123:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195938816:0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.724216:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195939072:0@lo:400:kworker.0 00000100:00100000:1.0:1787384475.724240:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384475.724279:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195938816 00000100:00100000:3.0:1787384475.724289:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195938816 00000100:00100000:0.0:1787384475.724310:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195938944:0@lo:400:kworker.0 00000100:00100000:3.0:1787384475.724393:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:3.0:1787384475.724405:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195938816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.735623:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384475.735731:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384475.735749:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195939200:0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.735791:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384475.735932:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195939072 00000100:00100000:2.0:1787384475.735943:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195939072 00000100:00100000:2.0:1787384475.736012:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195939200 00000100:00100000:2.0:1787384475.736016:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195939200 00000100:00100000:2.0:1787384475.736040:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787384475.736050:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195939072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.736136:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195939072:12345-0@lo:400:kworker.0 Request processed in 84us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384475.736144:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787384475.736197:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195939072:0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.736224:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787384475.736232:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195939200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.736264:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195939200:12345-0@lo:400:kworker.0 Request processed in 34us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384475.736270:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1787384475.736292:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344260e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195939200:0@lo:400:kworker.0 00000100:00080000:2.0:1787384475.736322:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384475.736703:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195939328:0@lo:400:kworker.0 00000100:00100000:1.0:1787384475.736752:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384475.740692:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384475.742082:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195938944 00000100:00100000:1.0:1787384475.742101:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195938944 00000100:00100000:1.0:1787384475.742225:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1787384475.742238:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195938944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384475.742356:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195938944:12345-0@lo:400:kworker.0 Request processed in 121us (1678us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384475.742365:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787384475.744107:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195939328 00000100:00100000:2.0:1787384475.744145:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195939328 00000100:00100000:2.0:1787384475.744229:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787384475.744240:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195939328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384475.744340:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195939328:12345-0@lo:400:kworker.0 Request processed in 102us (7586us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384475.744348:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787384475.744736:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344261880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195938944:0@lo:400:kworker.0 00000100:00080000:1.0:1787384475.744975:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384475.745010:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195939328:0@lo:400:kworker.0 00000100:00100000:3.0:1787384475.745208:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195938816:12345-0@lo:400:kworker.0 Request processed in 20803us (20965us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384475.745221:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787384475.745316:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344261180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195938816:0@lo:400:kworker.0 00000040:00080000:1.0:1787384476.171665:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384476.171679:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384476.171728:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:1.0:1787384476.171746:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787384476.171973:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fc9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195939456:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787384476.172111:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351fae480 going to sleep for 11 seconds 00000100:00100000:1.0:1787384476.190741:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.190924:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fc9180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195939456:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787384476.191366:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173904896 00000100:00100000:2.0:1787384476.191385:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173904896 00000100:00100000:2.0:1787384476.191461:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 112 00000100:00100000:2.0:1787384476.191473:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+56:10519:x1874208173904896:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787384476.191513:0:5783:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787384476.191678:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+56:10519:x1874208173904896:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 206us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384476.191686:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 112 00000100:00100000:2.0:1787384476.196843:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384476.197243:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173905024 00000100:00100000:1.0:1787384476.197253:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173905024 00000100:00100000:1.0:1787384476.197300:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 113 00000100:00100000:1.0:1787384476.197308:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+56:10519:x1874208173905024:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787384476.197395:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3b8a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197411:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3b8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197424:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3b8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197482:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3b91 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197490:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3b91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197497:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3b91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197517:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197537:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197544:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384476.197579:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787384476.197583:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787384476.197593:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197603:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3b8a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197609:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3b8a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197615:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3b8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197620:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384476.197624:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3b8a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197630:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3b8a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197640:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:1.0:1787384476.197644:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384476.197647:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3b8a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197663:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3b8a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197675:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3b91 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197681:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3b91 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197686:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3b91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197691:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624da00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384476.197694:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3b91 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197700:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3b91 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197707:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff89e346919600) 00010000:00010000:1.0:1787384476.197710:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384476.197712:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3b91 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197718:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3b91 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197732:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197737:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197748:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197753:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624ca00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384476.197756:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197762:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197770:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:1.0:1787384476.197773:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384476.197776:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.197782:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3b98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384476.197891:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+56:10519:x1874208173905024:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 552us (1026us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384476.197899:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 113 00000100:00100000:3.0:1787384476.202302:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.202473:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173905280 00000100:00100000:0.0:1787384476.202495:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173905280 00000100:00100000:0.0:1787384476.202546:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:0.0:1787384476.202556:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+56:10519:x1874208173905280:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384476.202577:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384476.202599:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3b9f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e94 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.202695:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.202709:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.202721:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384476.202732:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787384476.202825:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.202833:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ba6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.202840:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.202847:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384476.202851:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.202899:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ba6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.202991:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384476.202994:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787384476.202998:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ba6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.203004:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3ba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.203039:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3b9f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e94 expref: 58 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.203048:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:0.0:1787384476.203050:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384476.203054:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3b9f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e94 expref: 58 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.203062:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ac00, rc 0) 00000100:00100000:0.0:1787384476.203115:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344261180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+57:10519:x1874208173905280:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 560us (822us total) trans 4294967398 rc 301/301 00000100:00100000:0.0:1787384476.203123:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:3.0:1787384476.208834:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.209027:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173905408 00000100:00100000:0.0:1787384476.209039:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173905408 00000100:00100000:0.0:1787384476.209092:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:0.0:1787384476.209101:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+57:10519:x1874208173905408:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787384476.209139:0:5785:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787384476.209232:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+57:10519:x1874208173905408:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 131us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.209255:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:3.0:1787384476.213500:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.213953:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173905664 00000100:00100000:0.0:1787384476.213964:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173905664 00000100:00100000:0.0:1787384476.214025:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:0.0:1787384476.214035:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+57:10519:x1874208173905664:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384476.214055:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384476.214058:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787384476.214083:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c3b44 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e78 expref: 57 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.214115:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:0.0:1787384476.214120:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384476.214136:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3bb4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78e9b expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384476.215540:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:0.0:1787384476.215766:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3bbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.216540:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.216558:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3bbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.216643:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3bb4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e9b expref: 59 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.216684:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3bbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e9b expref: 58 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.216694:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751200) 00010000:00010000:0.0:1787384476.216697:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384476.216701:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108bc00, rc 0) 00000100:00100000:0.0:1787384476.216790:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344261880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+58:10519:x1874208173905664:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 2742us (3285us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787384476.216800:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:3.0:1787384476.225114:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.226034:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173905920 00000100:00100000:0.0:1787384476.226047:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173905920 00000100:00100000:0.0:1787384476.226118:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 117 00000100:00100000:0.0:1787384476.226128:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+58:10519:x1874208173905920:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384476.226210:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384476.226236:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3bbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e9b expref: 58 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226255:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751200) 00010000:00010000:0.0:1787384476.226266:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384476.226286:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3bc9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226299:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226309:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226330:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3bd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x56c0adf4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226338:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x56c0adf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226345:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x56c0adf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226429:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3bc9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226437:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3bc9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226443:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226448:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ac00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384476.226453:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3bc9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226459:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3bc9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226468:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:0.0:1787384476.226471:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384476.226475:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3bc9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226480:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3bc9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226498:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3bd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x56c0adf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226504:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3bd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x56c0adf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226509:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3bd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x56c0adf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226513:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384476.226516:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3bd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x56c0adf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226521:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3bd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x56c0adf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226528:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x56c0adf4 (ffff89e357751500) 00010000:00010000:0.0:1787384476.226530:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384476.226533:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3bd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x56c0adf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.226537:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3bd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x56c0adf4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.226633:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344260e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+57:10519:x1874208173905920:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 506us (1528us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384476.226640:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 117 00000004:00080000:1.0:1787384476.233529:0:7838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337376666827ns, next at 338376664459ns, rc = 0 00000100:00100000:0.0:1787384476.233763:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195939584:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384476.233884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384476.236745:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195939584 00000100:00100000:0.0:1787384476.236760:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195939584 00000100:00100000:0.0:1787384476.237976:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787384476.237992:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195939584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384476.238028:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384476.238105:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195939584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (4247us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.238112:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787384476.238166:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195939584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384476.243657:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.244968:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173906048 00000100:00100000:0.0:1787384476.244980:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173906048 00000100:00100000:0.0:1787384476.245036:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:0.0:1787384476.245046:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+57:10519:x1874208173906048:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384476.245064:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384476.245084:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3bd7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ea2 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.245120:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.245132:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.245143:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.245236:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3bd7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea2 expref: 59 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.245266:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea2 expref: 58 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.245274:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751b00) 00010000:00010000:0.0:1787384476.245278:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384476.245281:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a800, rc 0) 00000100:00100000:0.0:1787384476.245343:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+58:10519:x1874208173906048:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 298us (1693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.245350:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:3.0:1787384476.248548:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384476.248707:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173906304 00000100:00100000:1.0:1787384476.248717:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173906304 00000100:00100000:1.0:1787384476.248770:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:1.0:1787384476.248780:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+58:10519:x1874208173906304:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787384476.248890:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.248928:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.248940:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787384476.249246:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:1.0:1787384476.249535:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000078cb345e reply state 000000009f1fa24a transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384476.249545:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787384476.249633:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377960a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+60:10519:x1874208173906304:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 853us (1092us total) trans 4294967400 rc 0/0 00000100:00100000:1.0:1787384476.249641:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 119 00010000:00010000:3.0:1787384476.255902:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.255928:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.255936:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.255942:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624ca00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384476.255947:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.255954:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.255973:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751b00) 00010000:00010000:3.0:1787384476.255976:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787384476.255980:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.255995:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3be5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384476.266994:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384476.267750:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173906432 00000100:00100000:1.0:1787384476.267769:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173906432 00000100:00100000:1.0:1787384476.267831:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:1.0:1787384476.267840:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+59:10519:x1874208173906432:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384476.267882:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384476.267902:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3bec lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ea9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.267958:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3bec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea9 expref: 60 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.267975:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3bec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea9 expref: 60 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.268010:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751b00) 00010000:00010000:1.0:1787384476.268013:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384476.268016:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624da00, rc 0) 00000100:00100000:1.0:1787384476.268070:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377961f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+60:10519:x1874208173906432:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 230us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384476.268076:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 120 00000100:00100000:3.0:1787384476.272317:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384476.276339:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173906560 00000100:00100000:1.0:1787384476.276353:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173906560 00000100:00100000:1.0:1787384476.276424:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:1.0:1787384476.276433:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173906560:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1787384476.276745:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:2353:x1874208173906560:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 312us (4434us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787384476.276753:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00080000:1.0:1787384476.276775:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384476.286069:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384476.286530:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173906816 00000100:00100000:3.0:1787384476.286541:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173906816 00000100:00100000:3.0:1787384476.286595:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:3.0:1787384476.286605:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+60:10519:x1874208173906816:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787384476.286817:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+61:10519:x1874208173906816:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 213us (756us total) trans 4294967401 rc 0/0 00000100:00100000:3.0:1787384476.286825:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 30 00000001:00080000:1.0:1787384476.301292:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:1.0:1787384476.301310:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000100:00100000:1.0:1787384476.309111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384476.309360:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173907072 00000100:00100000:3.0:1787384476.309379:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173907072 00000100:00100000:3.0:1787384476.309427:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:3.0:1787384476.309435:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+61:10519:x1874208173907072:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787384476.309611:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+61:10519:x1874208173907072:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 176us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384476.309619:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:2.0:1787384476.314396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384476.314637:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173907200 00000100:00100000:1.0:1787384476.314647:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173907200 00000100:00100000:1.0:1787384476.314702:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 122 00000100:00100000:1.0:1787384476.314710:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+61:10519:x1874208173907200:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384476.314730:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384476.314748:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3bf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78eb0 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.314848:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c3bfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.315509:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c3bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.315522:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c3bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384476.315560:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787384476.315577:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c3bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.315603:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c3bf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb0 expref: 63 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.315617:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c3bfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb0 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.315624:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751b00) 00010000:00010000:1.0:1787384476.315627:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1787384476.315631:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624ce00, rc 0) 00000100:00100000:1.0:1787384476.315686:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+62:10519:x1874208173907200:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 976us (1298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384476.315694:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 122 00000100:00100000:3.0:1787384476.320655:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.321307:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173907328 00000100:00100000:0.0:1787384476.321318:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173907328 00000100:00100000:0.0:1787384476.321379:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:0.0:1787384476.321388:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173907328:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384476.321406:0:6576:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384476.321424:0:6576:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003c325b64/0x3522fbed3b6c3c01 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78eb7 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384476.321448:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89529b, blocks: 0x1 00010000:00010000:0.0:1787384476.321465:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=337s v=(0 0) 00010000:00010000:0.0:1787384476.321469:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384476.321478:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003c325b64/0x3522fbed3b6c3c01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb7 expref: 8 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.321495:0:6576:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003c325b64/0x3522fbed3b6c3c01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb7 expref: 8 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.321518:0:6576:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b800, rc 0) 00000100:00100000:0.0:1787384476.321570:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377960000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173907328:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 183us (923us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.321577:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:0.0:1787384476.329053:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384476.329187:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173907584 00000100:00100000:3.0:1787384476.329196:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173907584 00000100:00100000:3.0:1787384476.329275:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:3.0:1787384476.329286:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+62:10519:x1874208173907584:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787384476.329401:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+62:10519:x1874208173907584:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 117us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384476.329422:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 123 00000100:00100000:2.0:1787384476.332518:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384476.332588:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173907712 00000100:00100000:3.0:1787384476.332597:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173907712 00000100:00100000:3.0:1787384476.332644:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:3.0:1787384476.332654:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:10519:x1874208173907712:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384476.332673:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384476.332689:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ebe expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.332716:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c325b64/0x3522fbed3b6c3c01 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb7 expref: 9 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.332724:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384476.332728:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384476.332732:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 9 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.332762:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c325b64/0x3522fbed3b6c3c01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb7 expref: 9 pid: 6576 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.332775:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c325b64/0x3522fbed3b6c3c01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb7 expref: 9 pid: 6576 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384476.332788:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377962d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6574:1874208195939712:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384476.332894:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410fd80 going to sleep for 11 seconds 00000001:00080000:2.0:1787384476.333582:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1787384476.333602:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:2.0:1787384476.333638:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:2.0:1787384476.333668:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e341377780 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1787384476.333672:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e377a30600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e341377600 00000020:00080000:2.0:1787384476.333676:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e377a30d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e372946800 00000020:00080000:2.0:1787384476.333710:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e3732f7a80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1787384476.333714:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e37b6b5500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e3732f7840 00000020:00080000:2.0:1787384476.333717:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e37b6b5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e37b2e6c00 00000020:00080000:2.0:1787384476.333878:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787384476.334287:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:2.0:1787384476.334305:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195939840:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787384476.334494:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384476.334535:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384476.334542:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195939968:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787384476.334565:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384476.341292:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195939840 00000100:00100000:3.0:1787384476.341306:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195939840 00000100:00100000:2.0:1787384476.341543:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384476.341590:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377962d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6574:1874208195939712:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384476.341619:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 9 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384476.341640:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd600, rc 0) 00000100:00100000:2.0:1787384476.341685:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742d2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:10519:x1874208173907712:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 9033us (9172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384476.341693:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:2.0:1787384476.341829:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195939968 00000100:00100000:2.0:1787384476.341833:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195939968 00000100:00100000:3.0:1787384476.342341:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384476.342352:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195939840:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787384476.342397:0:10631:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:3.0:1787384476.342421:0:10631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.342437:0:10631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000053863fb0/0x3522fbed3b6c39d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e1d expref: 8 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.342445:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787384476.342448:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384476.342453:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.342483:0:10631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000053863fb0/0x3522fbed3b6c39d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e1d expref: 8 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.342494:0:10631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000053863fb0/0x3522fbed3b6c39d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e1d expref: 8 pid: 6576 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384476.342520:0:10631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377961500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10631:1874208195940096:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384476.342566:0:10631:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384476.343726:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787384476.343746:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195939968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787384476.343770:0:6576:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1787384476.344038:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a895299, atime: 0x6a895299, ctime: 0x6a895299, blocks: 0x1 00010000:00010000:1.0:1787384476.344047:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbe09189/0x3522fbed3b6c3c16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.344061:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=337s v=(0 0) 00010000:00010000:1.0:1787384476.344065:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384476.344071:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe09189/0x3522fbed3b6c3c16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.344086:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fbe09189/0x3522fbed3b6c3c16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.344096:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fbe09189/0x3522fbed3b6c3c16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.344103:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fbe09189/0x3522fbed3b6c3c16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.344122:0:6576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384476.344141:0:8292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384476.344148:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fbe09189/0x3522fbed3b6c3c16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.344155:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624cc00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384476.344159:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbe09189/0x3522fbed3b6c3c16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.344168:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fbe09189/0x3522fbed3b6c3c16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.344182:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fbe09189/0x3522fbed3b6c3c16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.344189:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fbe09189/0x3522fbed3b6c3c16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.344207:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384476.344209:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384476.344210:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384476.344660:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3306:x1874208195939968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 921us (10092us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1787384476.344669:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:0.0:1787384476.346054:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e377961180/2, rc 0, transno 4294967304 00000100:00100000:0.0:1787384476.346067:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377961180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195939968:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787384476.346142:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173907840 00000100:00100000:3.0:1787384476.346150:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173907840 00010000:00010000:3.0:1787384476.346193:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c325b64/0x3522fbed3b6c3c01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb7 expref: 9 pid: 6576 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384476.346243:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:3.0:1787384476.346251:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:2352:x1874208173907840:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384476.346264:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384476.346283:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c325b64/0x3522fbed3b6c3c01 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb7 expref: 9 pid: 6576 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.346295:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c325b64/0x3522fbed3b6c3c01 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb7 expref: 9 pid: 6576 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.346316:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c325b64/0x3522fbed3b6c3c01 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb7 expref: 9 pid: 6576 timeout: 437 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.346329:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384476.346334:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384476.346341:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 8 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.346350:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 8 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.346395:0:5768:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 8 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384476.346674:0:5768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377960e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5768:1874208195940224:192.168.203.51@tcp:105: 00000100:00100000:3.0:1787384476.346753:0:5768:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f780 going to sleep for 11 seconds 00000100:00080000:0.0:1787384476.347925:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384476.350223:0:10631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377961500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10631:1874208195940096:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384476.350254:0:10631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.350327:0:5768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377960e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5768:1874208195940224:192.168.203.51@tcp:105: 00010000:00010000:0.0:1787384476.350342:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384476.350438:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441da850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173907840:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 4187us (8898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.350449:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:3.0:1787384476.355773:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384476.355816:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384476.355886:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173907968 00000100:00100000:0.0:1787384476.355892:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173908096 00000100:00100000:2.0:1787384476.355896:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173907968 00000100:00100000:0.0:1787384476.355896:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173908096 00002000:00100000:2.0:1787384476.355956:0:6579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff89e377961500 x1874208173907968/t0(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:507/0 lens 504/0 e 0 to 0 dl 1787384487 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787384476.355967:0:6579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e377961500 with x1874208173907968 ext(0->12) 00002000:00010000:2.0:1787384476.355972:0:6579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e377961500 00000100:00100000:2.0:1787384476.355998:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:2.0:1787384476.356008:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:2353:x1874208173907968:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 00010000:00010000:0.0:1787384476.356072:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000053863fb0/0x3522fbed3b6c39d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e1d expref: 9 pid: 6576 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.356163:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:0.0:1787384476.356170:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377963800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+9:2353:x1874208173908096:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384476.356180:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384476.356185:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000053863fb0/0x3522fbed3b6c39d1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e1d expref: 9 pid: 6576 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.356199:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000053863fb0/0x3522fbed3b6c39d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e1d expref: 9 pid: 6576 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.356221:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000053863fb0/0x3522fbed3b6c39d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e1d expref: 9 pid: 6576 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.356234:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384476.356244:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384476.356249:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.356258:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.356290:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384476.356334:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377963800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+9:2353:x1874208173908096:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 162us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.356341:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 54 00010000:00010000:1.0:1787384476.356425:0:10631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.356435:0:10631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.356456:0:10631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.356464:0:10631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.356485:0:10631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787384476.356570:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377961500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:2353:x1874208173907968:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 Request processed in 562us (806us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1787384476.356576:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00002000:00100000:2.0:1787384476.356582:0:6579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff89e377961500 x1874208173907968/t4294967308(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:507/0 lens 504/448 e 0 to 0 dl 1787384487 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787384476.356590:0:6579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e377961500 with x1874208173907968 ext(0->12) 00002000:00010000:2.0:1787384476.356593:0:6579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e377961500 00000100:00100000:1.0:1787384476.357007:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195939840:12345-0@lo:6:osp-syn-1-0.0 Request processed in 14656us (22512us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787384476.357015:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1787384476.357073:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384476.357080:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.357099:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fdc00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384476.357102:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.357111:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.357125:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.357132:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3c0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.357153:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384476.357154:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384476.357164:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384476.357651:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1787384476.357658:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1787384476.357678:0:3306:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89e379fd4700 x1874208195939840/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787384492 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787384476.357689:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e379fd4700/2, rc 0, transno 4294967309 00000100:00100000:0.0:1787384476.357709:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fd4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195939840:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787384476.359023:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384476.359199:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173908224 00000100:00100000:1.0:1787384476.359207:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173908224 00000100:00100000:1.0:1787384476.359271:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:1.0:1787384476.359286:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+17:10519:x1874208173908224:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787384476.425689:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:3.0:1787384476.425706:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787384476.425770:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:3.0:1787384476.425789:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000020:00080000:0.0:1787384476.426097:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000020:00080000:0.0:1787384476.426116:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:1.0:1787384476.428566:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377960700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+15:10519:x1874208173908224:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 69268us (69536us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384476.428579:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 124 00000100:00100000:2.0:1787384476.433179:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384476.435273:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173908352 00000100:00100000:1.0:1787384476.435287:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173908352 00000100:00100000:1.0:1787384476.435401:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:1.0:1787384476.435412:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:2353:x1874208173908352:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787384476.510738:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1787384476.510754:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1787384476.510759:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:1.0:1787384476.510903:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173908352:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 75482us (77721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384476.510922:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:2.0:1787384476.520881:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.521778:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173908608 00000100:00100000:0.0:1787384476.521789:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173908608 00000100:00100000:0.0:1787384476.521885:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:0.0:1787384476.521910:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+15:10519:x1874208173908608:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384476.521965:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384476.521994:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c3bfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eb0 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.522031:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751b00) 00010000:00010000:0.0:1787384476.522037:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384476.522065:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.522076:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.522086:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384476.522330:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000087054d7e reply state 0000000016279cef transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.522340:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384476.522614:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+16:10519:x1874208173908608:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 718us (1764us total) trans 4294967402 rc 0/0 00000100:00100000:0.0:1787384476.522623:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 125 00000100:00100000:2.0:1787384476.539080:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:3.0:1787384476.539227:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.539240:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.539247:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.539254:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ac00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384476.539259:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.539267:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.539285:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751b00) 00010000:00010000:3.0:1787384476.539288:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384476.539292:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.539298:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3c1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.539518:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173908736 00000100:00100000:0.0:1787384476.539529:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173908736 00000100:00100000:0.0:1787384476.539667:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:0.0:1787384476.539677:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173908736:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787384476.545774:0:6574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1787384476.545785:0:6574:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787384474 00002000:00010000:1.0:1787384476.545788:0:6574:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787384473 00002000:00010000:1.0:1787384476.545789:0:6574:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787384475 -> 1787384474 00002000:00010000:1.0:1787384476.545792:0:6574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787384476.546491:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173908736:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 6808us (7575us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787384476.546503:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:2.0:1787384476.560542:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.560634:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173908992 00000100:00100000:0.0:1787384476.560643:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173908992 00000100:00100000:0.0:1787384476.560700:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:0.0:1787384476.560711:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+15:10519:x1874208173908992:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787384476.560777:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.560807:0:7691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea2 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.560816:0:7691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.560848:0:7691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea2 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.560904:0:7691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea2 expref: 15 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.560926:0:7691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195940352:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384476.561006:0:7691:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384476.568603:0:7691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195940352:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384476.568631:0:7691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384476.572218:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.572752:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173909120 00000100:00100000:0.0:1787384476.572762:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173909120 00010000:00010000:0.0:1787384476.572803:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea2 expref: 16 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.573028:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:0.0:1787384476.573040:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+16:2352:x1874208173909120:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384476.573055:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384476.573073:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea2 expref: 16 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.573097:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea2 expref: 16 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.573123:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3bde lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea2 expref: 16 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.573139:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751b00) 00010000:00010000:0.0:1787384476.573143:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.573152:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.573159:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.573189:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384476.573242:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+15:2352:x1874208173909120:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 204us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.573249:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 55 00010000:00010000:2.0:1787384476.576314:0:7691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384476.576333:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384476.576377:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384476.576385:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384476.576393:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384476.576399:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108bc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384476.576421:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384476.576428:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384476.576447:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751b00) 00010000:00010000:2.0:1787384476.576450:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787384476.576454:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384476.576460:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3c24 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384476.576566:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+14:10519:x1874208173908992:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 Request processed in 15852us (16037us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787384476.576577:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 126 00000100:00100000:2.0:1787384476.587168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.587309:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173909248 00000100:00100000:0.0:1787384476.587320:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173909248 00000100:00100000:0.0:1787384476.587495:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:0.0:1787384476.587506:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173909248:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787384476.587562:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.587601:0:6575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 7 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.587609:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384476.587613:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384476.587617:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.587653:0:6575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 7 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.587667:0:6575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 7 pid: 6574 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.587682:0:6575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6575:1874208195940480:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384476.587769:0:6575:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384476.593952:0:6575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6575:1874208195940480:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384476.593983:0:6575:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384476.595833:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.596374:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173909376 00000100:00100000:0.0:1787384476.596383:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173909376 00010000:00010000:0.0:1787384476.596422:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 8 pid: 6574 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.596481:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:0.0:1787384476.596491:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173909376:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384476.596506:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384476.596528:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 8 pid: 6574 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.596551:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 8 pid: 6574 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.596574:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3c08 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ebe expref: 8 pid: 6574 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.596590:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384476.596593:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384476.596598:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.596608:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.596837:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384476.596946:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173909376:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 455us (1120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.596953:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 56 00010000:00010000:1.0:1787384476.602570:0:6575:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.602589:0:6575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.602628:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.602637:0:6575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.602646:0:6575:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.602653:0:6575:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384476.602657:0:6575:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.602688:0:6575:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.602708:0:6575:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.602716:0:6575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ecfeb14b/0x3522fbed3b6c3c2b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384476.602823:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173909248:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 15315us (15660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384476.602833:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:2.0:1787384476.611949:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.612655:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173909632 00000100:00100000:0.0:1787384476.612667:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173909632 00000100:00100000:0.0:1787384476.612729:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 127 00000100:00100000:0.0:1787384476.612739:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+14:10519:x1874208173909632:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787384476.612818:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c32 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.612835:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.612846:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.613496:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.613511:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3bec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea9 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.613519:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.614404:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3bec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea9 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.614426:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3bec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea9 expref: 15 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.614443:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195940608:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384476.614600:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4540 going to sleep for 11 seconds 00000100:00100000:3.0:1787384476.626850:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384476.626944:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173909760 00000100:00100000:1.0:1787384476.626954:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173909760 00010000:00010000:1.0:1787384476.626993:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3bec lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea9 expref: 16 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384476.627026:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:1.0:1787384476.627036:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+16:2353:x1874208173909760:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384476.627050:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384476.627057:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3bec lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea9 expref: 16 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.627070:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3bec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea9 expref: 16 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.627126:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751b00) 00010000:00010000:1.0:1787384476.627130:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.627139:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.627146:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.627163:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384476.627268:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3bec lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ea9 expref: 16 pid: 5783 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.627282:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195940608:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384476.627300:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.627308:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.627313:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384476.627568:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1787384476.627716:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1787384476.627760:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:0.0:1787384476.627835:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195940736:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787384476.627926:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384476.627946:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e357700b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384476.628022:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195940736 00000100:00100000:0.0:1787384476.628026:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195940736 00000100:00100000:0.0:1787384476.628058:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384476.628065:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1874208195940736:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787384476.628136:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1874208195940736:12345-0@lo:1000:mdt00_002.0 Request processed in 71us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384476.628143:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384476.628183:0:5785:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:0.0:1787384476.628189:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e379fd4700, transno 4294967309 00000100:00100000:0.0:1787384476.628200:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195940736:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1787384476.628689:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1787384476.628741:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3733d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195940864:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787384476.628771:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384476.628788:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461e4540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384476.628801:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195940864 00000100:00100000:0.0:1787384476.628804:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195940864 00000100:00100000:0.0:1787384476.628827:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384476.628834:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1874208195940864:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787384476.628999:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5785:x1874208195940864:12345-0@lo:1000:mdt00_002.0 Request processed in 165us (226us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787384476.629006:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384476.629035:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3733d2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195940864:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1787384476.629057:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629067:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629074:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629080:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384476.629083:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629091:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629104:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e357751b00) 00010000:00010000:0.0:1787384476.629111:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384476.629115:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629122:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3c39 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629147:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629153:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629159:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629164:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384476.629167:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629172:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629179:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384476.629181:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384476.629187:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3b83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e8d expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629197:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3b83 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e8d expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629205:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3b83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e8d expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.629231:0:5785:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3b83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e8d expref: 19 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.629241:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379eebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195940992:192.168.203.51@tcp:105: 00000100:00100000:1.0:1787384476.633854:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377962680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+19:2353:x1874208173909760:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 6806us (7001us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384476.633885:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:0.0:1787384476.637672:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bcb000 going to sleep for 11 seconds 00000100:00100000:2.0:1787384476.646212:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384476.646305:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379eebb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195940992:192.168.203.51@tcp:105: 00010000:00010000:0.0:1787384476.646334:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646345:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3b7c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646385:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3c40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646398:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3c40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646409:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3c40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646418:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3c40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646423:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3c40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646428:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3c40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646450:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384476.646454:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3c40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646459:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3c40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646470:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384476.646473:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384476.646476:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3c40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646481:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3c40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646491:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c32 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646496:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c32 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646502:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646507:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384476.646510:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c32 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646515:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c32 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646533:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384476.646536:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384476.646539:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c32 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384476.646545:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c32 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384476.646787:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+18:10519:x1874208173909632:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 34049us (34847us total) trans 4294967407 rc 0/0 00000100:00100000:0.0:1787384476.646795:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 127 00000020:00080000:0.0:1787384476.646801:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787384476.646988:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384476.646992:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384476.647408:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1787384476.647416:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787384476.648441:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173909888 00000100:00100000:3.0:1787384476.648454:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173909888 00000100:00100000:3.0:1787384476.648508:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:3.0:1787384476.648518:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+18:10517:x1874208173909888:12345-192.168.203.51@tcp:49:lfs.0 00000100:00100000:3.0:1787384476.648630:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+18:10517:x1874208173909888:12345-192.168.203.51@tcp:49:lfs.0 Request processed in 113us (2428us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384476.648638:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:2.0:1787384476.655646:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384476.655694:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384476.655770:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173910400 00000100:00100000:3.0:1787384476.655780:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173910400 00000100:00100000:3.0:1787384476.655841:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:3.0:1787384476.655852:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+18:10519:x1874208173910400:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787384476.656557:0:5786:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787384476.656663:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:3.0:1787384476.656715:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.656730:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.656741:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.656748:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.656753:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.656766:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.656788:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787384476.656896:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350fb8c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+20:10519:x1874208173910400:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 1043us (1199us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1787384476.656904:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000020:00080000:3.0:1787384476.656909:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787384476.656953:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384476.656960:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.656966:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd000 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384476.656970:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.656979:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.656991:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff89e34836ac00) 00010000:00010000:3.0:1787384476.656993:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787384476.656997:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.657003:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd000/0x3522fbed3b6c3c47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.657018:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384476.657020:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384476.657022:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384476.657531:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173910144 00000100:00100000:1.0:1787384476.657538:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173910144 00000100:00100000:1.0:1787384476.657586:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 128 00000100:00100000:1.0:1787384476.657595:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+20:10517:x1874208173910144:12345-192.168.203.51@tcp:58:lfs.0 00000040:00080000:1.0:1787384476.657798:0:5783:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1787384476.657886:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+20:10517:x1874208173910144:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 265us (2222us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384476.657894:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 128 00010000:00010000:1.0:1787384476.685346:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384476.708013:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384476.708152:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173910528 00000100:00100000:1.0:1787384476.708164:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173910528 00000100:00100000:1.0:1787384476.708227:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 129 00000100:00100000:1.0:1787384476.708237:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+20:10521:x1874208173910528:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384476.708277:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384476.708298:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3c4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ec5 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.708360:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c55 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.708383:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.708394:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.708408:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3c5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.708415:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.708421:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.708758:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.708770:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e86 expref: 21 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.708778:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.709254:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e86 expref: 21 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.709278:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e86 expref: 21 pid: 7691 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384476.709294:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fca680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195941120:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384476.709435:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4300 going to sleep for 11 seconds 00000100:00100000:1.0:1787384476.715121:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fca680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195941120:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384476.715150:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384476.717074:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384476.717160:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173910784 00000100:00100000:3.0:1787384476.717171:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173910784 00000100:00100000:3.0:1787384476.717232:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:3.0:1787384476.717242:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+22:9206:x1874208173910784:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787384476.717550:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+23:9206:x1874208173910784:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 308us (483us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1787384476.717558:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:2.0:1787384476.721399:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384476.721488:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173910912 00000100:00100000:3.0:1787384476.721497:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173910912 00010000:00010000:3.0:1787384476.721587:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e86 expref: 23 pid: 7691 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384476.721659:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:3.0:1787384476.721669:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+23:2353:x1874208173910912:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384476.721682:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384476.721688:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e86 expref: 23 pid: 7691 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.721701:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e86 expref: 23 pid: 7691 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.721721:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3b6e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e86 expref: 23 pid: 7691 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.721735:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:3.0:1787384476.721740:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.721759:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.721767:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384476.721795:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384476.721842:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+22:2353:x1874208173910912:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 174us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384476.721850:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00010000:00010000:1.0:1787384476.721948:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.721956:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384476.721997:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787384476.722001:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787384476.722018:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722028:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722038:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c55 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722044:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c55 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722060:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722067:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384476.722071:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c55 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722078:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c55 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722095:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:1.0:1787384476.722097:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384476.722100:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c55 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722106:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c55 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722117:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3c5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722123:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3c5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722129:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3c5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722134:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384476.722136:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3c5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722150:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3c5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722157:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff89e346919c00) 00010000:00010000:1.0:1787384476.722160:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384476.722162:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3c5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722167:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3c5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722199:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3c4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ec5 expref: 22 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722211:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ec5 expref: 21 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384476.722218:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:1.0:1787384476.722220:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384476.722222:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c600, rc 0) 00000100:00100000:1.0:1787384476.722245:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+21:10521:x1874208173910528:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 14011us (14243us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384476.722251:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 129 00010000:00010000:0.0:1787384477.705067:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384477.706325:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787384477.706335:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384477.706428:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787384477.706435:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787384477.706568:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377962300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195941248:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787384477.707345:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f240 going to sleep for 11 seconds 00000040:00080000:1.0:1787384477.722436:0:11957:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787384477.722449:0:11957:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787384477.722499:0:11957:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787384477.722506:0:11957:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787384477.727514:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384477.727568:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377962300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195941248:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787384477.727713:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173911040 00000100:00100000:2.0:1787384477.727720:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173911040 00000100:00100000:2.0:1787384477.727779:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00100000:2.0:1787384477.727788:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+21:10532:x1874208173911040:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787384477.727819:0:7691:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787384477.728007:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+21:10532:x1874208173911040:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 219us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384477.728015:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 130 00000100:00080000:2.0:1787384477.728037:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384477.734722:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384477.735217:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173911296 00000100:00100000:0.0:1787384477.735228:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173911296 00000100:00100000:0.0:1787384477.735298:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 131 00000100:00100000:0.0:1787384477.735308:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+21:10532:x1874208173911296:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384477.735329:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384477.735351:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3c6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ecc expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384477.735456:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c71 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384477.735472:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384477.735485:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c71 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384477.735517:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787384477.735642:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3c6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ecc expref: 24 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384477.735661:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c71 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ecc expref: 23 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384477.735670:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384477.735672:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384477.735675:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108aa00, rc 0) 00000100:00100000:0.0:1787384477.735738:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377961c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+23:10532:x1874208173911296:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 431us (1026us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1787384477.735745:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 131 00000100:00100000:2.0:1787384477.753557:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384477.753596:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173911552 00000100:00100000:2.0:1787384477.753606:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173911552 00000100:00100000:2.0:1787384477.753656:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 132 00000100:00100000:2.0:1787384477.753665:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+23:10532:x1874208173911552:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787384477.753741:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3c7f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384477.753759:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384477.753770:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384477.753979:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3c7f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384477.753988:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3c7f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384477.754007:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384477.754013:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384477.754017:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3c7f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384477.754025:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3c7f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384477.754038:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:2.0:1787384477.754041:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787384477.754046:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3c7f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384477.754051:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3c7f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384477.754323:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+24:10532:x1874208173911552:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 657us (773us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1787384477.754333:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 132 00000040:00080000:2.0:1787384477.754454:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384477.754459:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384477.754954:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787384477.754962:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787384477.763168:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384477.768579:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173911680 00000100:00100000:0.0:1787384477.768596:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173911680 00000100:00100000:0.0:1787384477.768678:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:0.0:1787384477.768689:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+24:2350:x1874208173911680:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384477.768705:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384477.768730:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3c71 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ecc expref: 24 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384477.768750:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:0.0:1787384477.768756:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384477.768826:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+23:2350:x1874208173911680:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 139us (5667us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384477.768834:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1787384477.784193:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384477.784675:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173911936 00000100:00100000:3.0:1787384477.784686:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173911936 00000100:00100000:3.0:1787384477.784747:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:3.0:1787384477.784757:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+23:10532:x1874208173911936:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787384477.785051:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+24:10532:x1874208173911936:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 295us (868us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1787384477.785060:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00000001:00080000:0.0:1787384478.366442:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:0.0:1787384478.366464:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:0.0:1787384478.366786:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384478.366826:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384478.366883:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384478.366989:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173912192 00000100:00100000:1.0:1787384478.366999:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173912192 00000100:00100000:1.0:1787384478.367046:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 143 00000100:00100000:1.0:1787384478.367055:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+24:2350:x1874208173912192:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384478.367129:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eebb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+24:2350:x1874208173912192:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 75us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384478.367138:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 143 00000100:00100000:3.0:1787384478.367258:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173912448 00000100:00100000:3.0:1787384478.367263:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173912448 00000100:00100000:3.0:1787384478.367309:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:3.0:1787384478.367339:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173912448:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384478.367379:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173912448:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 42us (552us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384478.367386:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:0.0:1787384478.367475:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384478.367572:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384478.367593:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173912320 00000100:00100000:0.0:1787384478.367597:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173912320 00000100:00100000:0.0:1787384478.367624:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:0.0:1787384478.367631:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173912320:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384478.367664:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+5:2351:x1874208173912320:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 34us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384478.367670:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00080000:1.0:1787384478.368097:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384478.368101:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384478.368254:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173912576 00000100:00100000:0.0:1787384478.368259:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173912576 00000100:00100000:0.0:1787384478.368300:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:0.0:1787384478.368307:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173912576:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384478.368352:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2351:x1874208173912576:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 45us (779us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384478.368368:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00080000:1.0:1787384478.368527:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384478.369673:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173912064 00000100:00100000:3.0:1787384478.369682:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173912064 00000100:00100000:3.0:1787384478.369765:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 292 00000100:00100000:3.0:1787384478.369785:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173912064:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384478.369848:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173912064:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 74us (2963us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384478.369855:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 292 00010000:00010000:3.0:1787384478.729162:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384479.753246:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384479.829597:0:12010:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787384479.829608:0:12010:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384479.829659:0:12010:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787384479.829665:0:12010:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384480.101656:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384480.101961:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173912832 00000100:00100000:1.0:1787384480.101970:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173912832 00000100:00100000:1.0:1787384480.102042:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 133 00000100:00100000:1.0:1787384480.102053:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+24:10553:x1874208173912832:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384480.102084:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384480.102104:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3c86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ed3 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.102201:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c3c8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.102216:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c3c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.102228:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c3c8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384480.102238:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787384480.102364:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3c86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ed3 expref: 27 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.102393:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c3c8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ed3 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.102401:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:1.0:1787384480.102403:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787384480.102406:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d000, rc 0) 00000100:00100000:1.0:1787384480.102472:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+26:10553:x1874208173912832:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 421us (824us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1787384480.102480:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 133 00000100:00080000:2.0:1787384480.102782:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384480.107948:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384480.108186:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173912960 00000100:00100000:1.0:1787384480.108196:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173912960 00000100:00100000:1.0:1787384480.108265:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:1.0:1787384480.108275:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+26:10553:x1874208173912960:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:1.0:1787384480.108340:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.108366:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.108378:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.108406:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.108412:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.108433:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.108438:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384480.108442:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.108449:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.108460:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:1.0:1787384480.108464:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384480.108468:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384480.108474:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3c9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384480.108547:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+26:10553:x1874208173912960:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 273us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384480.108555:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 134 00000100:00100000:0.0:1787384480.301025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384480.301117:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173913088 00000100:00100000:3.0:1787384480.301127:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173913088 00000100:00100000:3.0:1787384480.301206:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:3.0:1787384480.301217:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173913088:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:3.0:1787384480.301235:0:10631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384480.301258:0:10631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c3ca2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78eda expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384480.301286:0:10631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a89529a, atime: 0x6a895299, ctime: 0x6a89529a, blocks: 0xb 00010000:00010000:3.0:1787384480.301321:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=341s v=(0 0) 00010000:00010000:3.0:1787384480.301326:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384480.301336:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c3ca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eda expref: 7 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384480.301362:0:10631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c3ca2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eda expref: 7 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384480.301376:0:10631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd000, rc 0) 00000100:00100000:3.0:1787384480.301442:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173913088:12345-192.168.203.51@tcp:101:cat.0 Request processed in 228us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.301451:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00080000:2.0:1787384480.301532:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384480.308251:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384480.308359:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173913216 00000100:00100000:3.0:1787384480.308368:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173913216 00002000:00100000:3.0:1787384480.308418:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff89e377968380 x1874208173913216/t0(0) o3->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:511/0 lens 488/0 e 0 to 0 dl 1787384491 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384480.308429:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e377968380 with x1874208173913216 ext(0->4095) 00002000:00010000:3.0:1787384480.308435:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e377968380 00000100:00100000:3.0:1787384480.308467:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:3.0:1787384480.308477:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173913216:12345-192.168.203.51@tcp:3:cat.0 00000100:00100000:3.0:1787384480.308725:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173913216:12345-192.168.203.51@tcp:3:cat.0 Request processed in 248us (482us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787384480.308733:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00002000:00100000:3.0:1787384480.308739:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff89e377968380 x1874208173913216/t0(0) o3->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:511/0 lens 488/4536 e 0 to 0 dl 1787384491 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384480.308767:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e377968380 with x1874208173913216 ext(0->4095) 00002000:00010000:3.0:1787384480.308771:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e377968380 00000100:00100000:1.0:1787384480.329238:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384480.329263:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195941376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384480.329353:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.329593:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195941376 00000100:00100000:3.0:1787384480.329602:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195941376 00000100:00100000:3.0:1787384480.329675:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787384480.329687:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195941376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384480.329728:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384480.329779:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195941376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.329786:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787384480.329912:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1787384480.329920:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1787384480.329944:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e377961180, transno 4294967304 00000100:00100000:1.0:1787384480.329958:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377962a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195941376:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787384480.330322:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787384480.779759:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384480.841788:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195941632:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.841898:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384480.841992:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195941504:0@lo:400:kworker.0 00000100:00100000:1.0:1787384480.842035:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384480.842129:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195941760:0@lo:400:kworker.0 00000100:00100000:2.0:1787384480.842159:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.844554:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195941504 00000100:00100000:3.0:1787384480.844570:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195941504 00000100:00100000:3.0:1787384480.844635:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787384480.844645:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195941504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.844794:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195941504:12345-0@lo:400:kworker.0 Request processed in 149us (2757us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.844802:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1787384480.844990:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195941888:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.845025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384480.845070:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195941632 00000100:00100000:3.0:1787384480.845075:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195941632 00000100:00100000:3.0:1787384480.845107:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195941760 00000100:00100000:3.0:1787384480.845111:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195941760 00000100:00100000:3.0:1787384480.845149:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195941888 00000100:00100000:3.0:1787384480.845152:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195941888 00000100:00100000:3.0:1787384480.845168:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1787384480.845576:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787384480.845588:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195941760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384480.845647:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195941760:12345-0@lo:400:kworker.0 Request processed in 63us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384480.845654:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787384480.845672:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787384480.845680:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195941888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.845777:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195941632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384480.845917:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195941504:0@lo:400:kworker.0 00000100:00100000:1.0:1787384480.845927:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195942016:0@lo:400:kworker.0 00000100:00100000:3.0:1787384480.846005:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377961180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195941632:12345-0@lo:400:kworker.0 Request processed in 830us (4107us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384480.846012:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787384480.846047:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195941632:0@lo:400:kworker.0 00000100:00080000:3.0:1787384480.846090:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384480.848623:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195941760:0@lo:400:kworker.0 00000100:00100000:0.0:1787384480.853379:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377960380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195941888:12345-0@lo:400:kworker.0 Request processed in 7690us (8342us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384480.853393:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787384480.853483:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384480.853560:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195942016 00000100:00100000:0.0:1787384480.853567:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195942016 00000100:00100000:0.0:1787384480.853635:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787384480.853645:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195942016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384480.853711:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195942016:12345-0@lo:400:kworker.0 Request processed in 67us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384480.853718:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384480.854006:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195942016:0@lo:400:kworker.0 00000100:00080000:2.0:1787384480.854810:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384480.856334:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372f1f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195941888:0@lo:400:kworker.0 00000004:00080000:1.0:1787384481.357191:0:7838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342500328012ns, next at 343500325493ns, rc = 0 00000100:00100000:2.0:1787384481.357266:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195942144:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384481.357328:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384481.357731:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195942144 00000100:00100000:1.0:1787384481.357739:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195942144 00000100:00100000:1.0:1787384481.357794:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787384481.357802:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195942144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384481.357836:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384481.357967:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195942144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 164us (638us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384481.357974:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787384481.359006:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fc9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195942144:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1787384481.811288:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787384481.870690:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384481.870700:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384481.870734:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1787384481.870740:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:2.0:1787384481.952174:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1787384481.952189:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1787384481.953225:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000020:00080000:3.0:1787384481.953378:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e242731cc0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:3.0:1787384481.953385:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e35021c000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e242731480 00000020:00080000:3.0:1787384481.953388:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e35021ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e379eff400 00000004:00080000:3.0:1787384481.953416:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:3.0:1787384481.953433:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000100:00100000:1.0:1787384481.953928:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e372cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195942272:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787384481.953994:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384481.954064:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195942272 00000100:00100000:2.0:1787384481.954072:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195942272 00000020:00080000:0.0:1787384481.954114:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000100:00100000:2.0:1787384481.954125:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787384481.954135:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195942272:12345-0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1787384481.954301:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00002000:00010000:2.0:1787384481.955030:0:10631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787384481.955036:0:10631:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787384474 -> 1787384474 00002000:00010000:2.0:1787384481.955038:0:10631:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1787384473 -> 1787384473 00002000:00010000:2.0:1787384481.955040:0:10631:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787384474 -> 1787384474 00002000:00010000:2.0:1787384481.955042:0:10631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1787384481.955100:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1874208195942272:12345-0@lo:2:osp-syn-1-0.0 Request processed in 965us (1104us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787384481.955109:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787384481.955156:0:3307:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1787384481.955162:0:3307:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1787384481.955355:0:3307:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89e372cd6a00 x1874208195942272/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787384497 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1787384481.955367:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e372cd6a00/2, rc 0, transno 4294967312 00000100:00100000:0.0:1787384481.955372:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e372cd6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195942272:0@lo:2:osp-syn-1-0.0 00010000:00010000:3.0:1787384482.829101:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384483.486154:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384483.486210:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384483.486232:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173913472 00000100:00100000:1.0:1787384483.486249:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173913472 00000100:00100000:3.0:1787384483.486262:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384483.486308:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384483.486370:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384483.486375:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 148 00000100:00100000:1.0:1787384483.486394:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+13:2353:x1874208173913472:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384483.486414:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173913344 00000100:00100000:3.0:1787384483.486424:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173913344 00000100:00100000:3.0:1787384483.486476:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 294 00000100:00100000:3.0:1787384483.486489:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173913344:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384483.486501:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377961880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+13:2353:x1874208173913472:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 110us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384483.486550:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 148 00000100:00100000:1.0:1787384483.486576:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173913856 00000100:00100000:1.0:1787384483.486582:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173913856 00000100:00100000:3.0:1787384483.486598:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e69450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173913344:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 107us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384483.486607:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 294 00000100:00100000:1.0:1787384483.486620:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 149 00000100:00100000:1.0:1787384483.486630:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173913856:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384483.486657:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173913728 00000100:00100000:3.0:1787384483.486664:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173913728 00000100:00100000:1.0:1787384483.486672:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377962a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2353:x1874208173913856:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 42us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384483.486680:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 149 00000100:00100000:3.0:1787384483.486712:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173913600 00000100:00100000:3.0:1787384483.486719:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173913600 00000100:00100000:3.0:1787384483.486762:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:3.0:1787384483.486773:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173913728:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384483.486786:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:0.0:1787384483.486804:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173913600:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384483.486823:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173913728:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 51us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384483.486833:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:0.0:1787384483.486890:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377963480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173913600:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 90us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384483.486900:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00080000:2.0:1787384483.487443:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384483.487449:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384483.487454:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787384483.853612:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384484.873307:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384485.449274:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195942400:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384485.449388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384485.449606:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195942400 00000100:00100000:3.0:1787384485.449617:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195942400 00000100:00100000:3.0:1787384485.449699:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787384485.449711:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195942400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384485.449762:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384485.449817:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195942400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384485.449825:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:2.0:1787384485.449984:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384485.450141:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195942400:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384485.504730:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384485.504901:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173913984 00000100:00100000:1.0:1787384485.504917:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173913984 00000100:00100000:1.0:1787384485.505012:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 135 00000100:00100000:1.0:1787384485.505026:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+13:10198:x1874208173913984:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787384485.505189:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+13:10198:x1874208173913984:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 Request processed in 165us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384485.505198:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 135 00000100:00080000:2.0:1787384485.505379:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384485.514393:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384485.514707:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173914240 00000100:00100000:2.0:1787384485.514722:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173914240 00000100:00100000:2.0:1787384485.514803:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:2.0:1787384485.514815:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+13:10198:x1874208173914240:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787384485.515725:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+14:10198:x1874208173914240:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 903us (1339us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1787384485.515737:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 35 00010000:00010000:2.0:1787384485.897038:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384485.934283:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384485.934409:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173914368 00000100:00100000:0.0:1787384485.934420:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173914368 00000100:00100000:0.0:1787384485.934509:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00100000:0.0:1787384485.934520:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:11006:x1874208173914368:12345-192.168.203.51@tcp:101:lsof.0 00010000:00010000:0.0:1787384485.934542:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384485.934564:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3ca9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ee1 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.934626:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.934640:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.934651:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384485.935114:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787384485.935119:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384485.935220:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.935258:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3ca9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee1 expref: 7 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.935276:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee1 expref: 6 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384485.935285:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:0.0:1787384485.935288:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384485.935292:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108bc00, rc 0) 00000100:00100000:0.0:1787384485.935416:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377960e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:11006:x1874208173914368:12345-192.168.203.51@tcp:101:lsof.0 Request processed in 897us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384485.935425:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 136 00000100:00080000:2.0:1787384485.935616:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384485.962382:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195942528:0@lo:400:kworker.0 00000100:00100000:3.0:1787384485.962426:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195942784:0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.962499:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195942656:0@lo:400:kworker.0 00000100:00100000:0.0:1787384485.962577:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195942912:0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.965651:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384485.965749:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195943040:0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.965794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384485.965878:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195943040 00000100:00100000:1.0:1787384485.965886:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195943040 00000100:00100000:1.0:1787384485.965943:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1787384485.965951:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195943040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.966019:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195943040:12345-0@lo:400:kworker.0 Request processed in 68us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384485.966027:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00080000:1.0:1787384485.966051:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384485.966086:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377969880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195943040:0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.966130:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195942528 00000100:00100000:1.0:1787384485.966134:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195942528 00000100:00100000:1.0:1787384485.966158:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787384485.966164:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195942528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.966198:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e6b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195942528:12345-0@lo:400:kworker.0 Request processed in 34us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384485.966204:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787384485.966235:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377963100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195942528:0@lo:400:kworker.0 00000100:00100000:0.0:1787384485.967121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384485.967229:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195942912 00000100:00100000:1.0:1787384485.967235:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195942912 00000100:00100000:1.0:1787384485.967320:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787384485.967329:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195942912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.967375:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195942912:12345-0@lo:400:kworker.0 Request processed in 47us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384485.967382:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787384485.967446:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384485.967475:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195943168:0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.967507:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384485.967615:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195943168 00000100:00100000:0.0:1787384485.967620:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195943168 00000100:00100000:0.0:1787384485.967655:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787384485.967663:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195943168:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787384485.967710:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384485.967751:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377962300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195942912:0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.967786:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195942656 00000100:00100000:1.0:1787384485.967790:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195942656 00000100:00100000:1.0:1787384485.967811:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1787384485.967817:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195942656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384485.969287:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384485.969396:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195942784 00000100:00100000:3.0:1787384485.969407:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195942784 00000100:00100000:0.0:1787384485.969474:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195943168:12345-0@lo:400:kworker.0 Request processed in 1805us (1958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384485.969488:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787384485.969501:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1787384485.969515:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195942784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384485.969599:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195942784:12345-0@lo:400:kworker.0 Request processed in 88us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384485.970072:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377962d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195942784:0@lo:400:kworker.0 00000100:00100000:1.0:1787384485.970238:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195942656:12345-0@lo:400:kworker.0 Request processed in 2419us (2790us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384485.970246:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787384485.970497:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:3.0:1787384485.970529:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384485.977484:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195943168:0@lo:400:kworker.0 00000100:00100000:2.0:1787384485.977590:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377960000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195942656:0@lo:400:kworker.0 00000100:00100000:0.0:1787384486.475575:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195943296:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384486.475682:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384486.475960:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195943296 00000100:00100000:1.0:1787384486.475970:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195943296 00000100:00100000:1.0:1787384486.476026:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384486.476036:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b59dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874208195943296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384486.476082:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384486.476186:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b59dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3307:x1874208195943296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384486.476193:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787384486.476836:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fcb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195943296:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384486.921324:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1787384487.048039:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:3.0:1787384487.048071:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:0.0:1787384487.048342:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:0.0:1787384487.048371:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1787384487.059392:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:3.0:1787384487.945600:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384488.605957:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384488.606003:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384488.606031:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384488.606148:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173914752 00000100:00100000:1.0:1787384488.606160:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173914752 00000100:00100000:1.0:1787384488.606234:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:1.0:1787384488.606245:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173914752:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384488.606359:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2350:x1874208173914752:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 116us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384488.606368:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:3.0:1787384488.606716:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173914496 00000100:00100000:3.0:1787384488.606723:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173914496 00000100:00100000:3.0:1787384488.606765:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 296 00000100:00100000:3.0:1787384488.606773:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2350:x1874208173914496:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384488.606802:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2350:x1874208173914496:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 30us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384488.606809:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 296 00000100:00080000:3.0:1787384488.606841:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384488.607192:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384488.608375:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384488.611452:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173915008 00000100:00100000:2.0:1787384488.611475:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173915008 00000100:00100000:2.0:1787384488.611955:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173914624 00000100:00100000:2.0:1787384488.611962:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173914624 00000100:00100000:2.0:1787384488.612006:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 153 00000100:00100000:2.0:1787384488.612018:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2350:x1874208173915008:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384488.612510:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2350:x1874208173915008:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 491us (6475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384488.612520:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 153 00000100:00100000:2.0:1787384488.612549:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 154 00000100:00100000:2.0:1787384488.612556:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+13:2350:x1874208173914624:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384488.612657:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+13:2350:x1874208173914624:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 101us (5466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384488.612664:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 154 00000100:00080000:0.0:1787384488.613722:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384488.614295:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173914880 00000100:00100000:3.0:1787384488.614309:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173914880 00000100:00100000:2.0:1787384488.614450:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:2.0:1787384488.614462:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173914880:12345-192.168.203.51@tcp:400:kworker.0 00000100:00080000:0.0:1787384488.614551:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384488.614556:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2350:x1874208173914880:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 94us (6187us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384488.614567:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 74 00010000:00010000:1.0:1787384488.969088:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787384489.752753:0:12213:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 03:41:27 (1787384487) 00010000:00010000:2.0:1787384489.996128:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384490.574704:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384490.574737:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195943424:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384490.574845:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384490.575055:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195943424 00000100:00100000:3.0:1787384490.575068:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195943424 00000100:00100000:3.0:1787384490.575164:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787384490.575175:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195943424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384490.575223:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384490.575310:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195943424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384490.575319:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1787384490.577336:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384490.577411:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37796b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195943424:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787384491.017336:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787384491.081702:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384491.081718:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1787384491.082546:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195943680:0@lo:400:kworker.0 00000100:00100000:3.0:1787384491.082650:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384491.082729:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195944192:0@lo:400:kworker.0 00000100:00100000:3.0:1787384491.082786:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384491.082827:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384491.082833:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195943808:0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.082939:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195943680 00000100:00100000:1.0:1787384491.082950:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195943680 00000100:00100000:1.0:1787384491.083009:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787384491.083019:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195943680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.083082:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195943680:12345-0@lo:400:kworker.0 Request processed in 64us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384491.083091:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787384491.083161:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195943936:0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.083191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384491.083217:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787384491.083224:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195943552:0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.083251:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384491.083283:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195944064:0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.083306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384491.083333:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195944192 00000100:00100000:1.0:1787384491.083337:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195944192 00000100:00100000:1.0:1787384491.083376:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195943936 00000100:00100000:1.0:1787384491.083379:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195943936 00000100:00100000:1.0:1787384491.083397:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787384491.083403:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195944192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.083436:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195944192:12345-0@lo:400:kworker.0 Request processed in 33us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384491.083442:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787384491.083454:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787384491.083458:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195943936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.083488:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195943936:12345-0@lo:400:kworker.0 Request processed in 29us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384491.083493:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787384491.083509:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195943552 00000100:00100000:1.0:1787384491.083512:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195943552 00000100:00100000:1.0:1787384491.083535:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787384491.083542:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195943552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.083571:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195943552:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384491.083587:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00080000:1.0:1787384491.083615:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384491.083648:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195943552:0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.083664:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fcad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195943936:0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.083703:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195944064 00000100:00100000:1.0:1787384491.083707:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195944064 00000040:00080000:0.0:1787384491.083724:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:0.0:1787384491.083734:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787384491.083735:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787384491.083740:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195944064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384491.083774:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344263100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1874208195944064:12345-0@lo:400:kworker.0 Request processed in 34us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384491.083781:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:1.0:1787384491.083798:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384491.083815:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fc8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195944064:0@lo:400:kworker.0 00000100:00100000:3.0:1787384491.088340:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384491.088424:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fcbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195943680:0@lo:400:kworker.0 00000100:00100000:3.0:1787384491.088439:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1787384491.088445:0:3306:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e372cd6a00, transno 4294967312 00000100:00100000:3.0:1787384491.088463:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fc9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195944192:0@lo:400:kworker.0 00000100:00100000:3.0:1787384491.088549:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195943808 00000100:00100000:3.0:1787384491.088557:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195943808 00000100:00100000:3.0:1787384491.088629:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1787384491.088639:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195943808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384491.088707:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195943808:12345-0@lo:400:kworker.0 Request processed in 68us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384491.088715:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:3.0:1787384491.088743:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384491.088774:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fc8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195943808:0@lo:400:kworker.0 00000100:00100000:0.0:1787384491.153284:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384491.156519:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173915264 00000100:00100000:2.0:1787384491.156543:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173915264 00000100:00100000:2.0:1787384491.156654:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 137 00000100:00100000:2.0:1787384491.156667:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+13:11271:x1874208173915264:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384491.156695:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384491.156723:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3cb7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ee8 expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.156840:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3cbe lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.156857:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3cbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.156890:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3cbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.156907:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3cc5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.156914:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.156921:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787384491.157353:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787384491.158687:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3ccc lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.158709:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3ccc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.158721:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3ccc lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384491.158735:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787384491.158989:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3cbe lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.158997:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3cbe lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.159012:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3cbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.159019:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384491.159023:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3cbe lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.159032:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3cbe lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.159047:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e34836a700) 00010000:00010000:2.0:1787384491.159051:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384491.159056:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3cbe lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.159063:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3cbe lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.159078:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3cc5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.159085:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3cc5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.159091:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.164297:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384491.164309:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3cc5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.164354:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3cc5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.164378:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89e345695c00) 00010000:00010000:2.0:1787384491.164382:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384491.164387:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3cc5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.164396:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3cc5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.165261:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3cb7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee8 expref: 16 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.171534:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3ccc lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee8 expref: 15 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.171550:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:2.0:1787384491.171553:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384491.171557:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366120400, rc 0) 00000100:00100000:2.0:1787384491.171670:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+15:11271:x1874208173915264:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 15004us (18410us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787384491.171683:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 137 00000100:00100000:3.0:1787384491.177311:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384491.177567:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173915520 00000100:00100000:2.0:1787384491.177580:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173915520 00000100:00100000:2.0:1787384491.177828:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:2.0:1787384491.177840:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+15:2352:x1874208173915520:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384491.177902:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384491.177935:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3ccc lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee8 expref: 15 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384491.177958:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:2.0:1787384491.177963:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384491.179948:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441dbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+14:2352:x1874208173915520:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 2092us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384491.179967:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:1.0:1787384491.180899:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384491.181204:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173915392 00000100:00100000:3.0:1787384491.181216:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173915392 00000100:00100000:3.0:1787384491.181519:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 138 00000100:00100000:3.0:1787384491.181532:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+14:11271:x1874208173915392:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787384491.181782:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+14:11271:x1874208173915392:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 254us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384491.181792:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 138 00000100:00100000:1.0:1787384491.595282:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384491.595314:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195944320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384491.595419:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384491.595525:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195944320 00000100:00100000:1.0:1787384491.595536:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195944320 00000100:00100000:1.0:1787384491.595612:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787384491.595629:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195944320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384491.595690:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384491.595773:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344263b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195944320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 146us (353us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384491.595785:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1787384491.595906:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195944320:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384492.042018:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787384492.106136:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384492.106149:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384492.107741:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:2.0:1787384492.107762:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787384492.178968:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00010000:00010000:1.0:1787384493.070135:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384493.385415:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384493.385505:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173915648 00000100:00100000:1.0:1787384493.385521:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173915648 00000100:00100000:1.0:1787384493.385624:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 139 00000100:00100000:1.0:1787384493.385638:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+13:11315:x1874208173915648:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384493.385670:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384493.385697:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3cda lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78eef expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.385794:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ce1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.385811:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.385824:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.385843:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3ce8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.385849:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.385856:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787384493.386144:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787384493.386418:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ce1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386441:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ce1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386450:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386457:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624ca00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384493.386463:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ce1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386472:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ce1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386492:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:1.0:1787384493.386496:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384493.386502:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ce1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386509:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ce1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386525:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3ce8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386532:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3ce8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386539:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386544:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384493.386553:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3ce8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386559:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3ce8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386567:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89e346919c00) 00010000:00010000:1.0:1787384493.386570:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384493.386573:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3ce8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386579:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3ce8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386625:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3cda lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eef expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386637:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:1.0:1787384493.386639:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384493.386642:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3cda lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eef expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.386652:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624da00, rc 0) 00000100:00100000:1.0:1787384493.386763:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+13:11315:x1874208173915648:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1128us (1371us total) trans 0 rc 301/301 00000100:00100000:1.0:1787384493.386772:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 139 00000100:00100000:0.0:1787384493.394335:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384493.405562:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173915904 00000100:00100000:1.0:1787384493.405581:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173915904 00000100:00100000:1.0:1787384493.405676:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 140 00000100:00100000:1.0:1787384493.405689:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+13:11315:x1874208173915904:12345-192.168.203.51@tcp:36:lfs.0 00010000:00010000:1.0:1787384493.405797:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384493.405833:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3658 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d28 expref: 13 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.405856:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:1.0:1787384493.405878:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787384493.406234:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.406263:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee1 expref: 5 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.406274:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.406320:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee1 expref: 5 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.406337:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee1 expref: 5 pid: 5783 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384493.406357:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e344262300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195944448:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384493.406493:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aefb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384493.419406:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384493.419452:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173916032 00000100:00100000:1.0:1787384493.419462:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173916032 00010000:00010000:1.0:1787384493.419528:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee1 expref: 6 pid: 5783 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384493.419589:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:1.0:1787384493.419600:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344260000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2352:x1874208173916032:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384493.419620:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384493.419628:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee1 expref: 6 pid: 5783 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.419642:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee1 expref: 6 pid: 5783 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.419671:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:1.0:1787384493.419677:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.419688:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.419697:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.419727:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384493.419786:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344260000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2352:x1874208173916032:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 188us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384493.419794:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00080000:1.0:1787384493.419826:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787384493.422238:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3cb0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ee1 expref: 5 pid: 5783 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384493.422280:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e344262300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195944448:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384493.422316:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.422328:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.422334:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.422378:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.422394:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.422417:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384493.431079:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787384493.431109:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.431122:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.431131:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.431138:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624dc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384493.431143:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.431151:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.431173:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34836a200) 00010000:00010000:3.0:1787384493.431176:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384493.431183:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.431189:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3cef lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787384493.431220:0:5785:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e484559c reply state 0000000090f1ff41 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384493.431246:0:5785:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384493.432131:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+14:11315:x1874208173915904:12345-192.168.203.51@tcp:36:lfs.0 Request processed in 26434us (37801us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1787384493.432144:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 140 00010000:00010000:3.0:1787384493.435308:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.435332:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.435349:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.435356:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384493.435362:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.435371:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.435398:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89e34836a500) 00010000:00010000:3.0:1787384493.435403:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384493.435409:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.435417:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3cf6 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384493.525711:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384493.527429:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173916160 00000100:00100000:0.0:1787384493.527452:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173916160 00000100:00100000:0.0:1787384493.527544:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 141 00000100:00100000:0.0:1787384493.527557:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+13:11323:x1874208173916160:12345-192.168.203.51@tcp:101:lctl.0 00010000:00010000:0.0:1787384493.527588:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384493.527620:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3cfd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ef6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.527707:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3d04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.527723:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3d04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.527747:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3d04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384493.527929:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787384493.527934:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384493.528041:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3d04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.528075:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3cfd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ef6 expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.528096:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3d04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ef6 expref: 14 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.528107:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:0.0:1787384493.528110:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384493.528115:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a800, rc 0) 00000100:00100000:0.0:1787384493.528204:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344263800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+14:11323:x1874208173916160:12345-192.168.203.51@tcp:101:lctl.0 Request processed in 648us (2508us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384493.528212:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 141 00000100:00100000:1.0:1787384493.632729:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384493.632942:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173916288 00000100:00100000:2.0:1787384493.632956:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173916288 00000100:00100000:2.0:1787384493.633164:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 142 00000100:00100000:2.0:1787384493.633177:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+14:11329:x1874208173916288:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384493.633215:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384493.633245:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3d0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78efd expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.633359:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3d12 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.633376:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3d12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.633417:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3d12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.633437:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3d19 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.633444:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3d19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.633451:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3d19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.642836:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3d20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.642889:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.642905:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384493.642989:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787384493.642994:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384493.643031:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643046:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3d12 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643053:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3d12 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643097:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3d12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643105:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384493.643110:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3d12 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643118:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3d12 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643132:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:2.0:1787384493.643135:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384493.643139:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3d12 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643146:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120c00/0x3522fbed3b6c3d12 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643162:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3d19 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643168:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3d19 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643174:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3d19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643180:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384493.643183:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3d19 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643198:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3d19 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643207:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff89e345695c00) 00010000:00010000:2.0:1787384493.643210:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384493.643214:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3d19 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643219:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121c00/0x3522fbed3b6c3d19 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643278:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120400/0x3522fbed3b6c3d0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78efd expref: 16 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643299:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78efd expref: 15 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.643307:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384493.643309:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787384493.643313:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e366121400, rc 0) 00000100:00100000:2.0:1787384493.643395:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344262300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+15:11329:x1874208173916288:12345-192.168.203.51@tcp:101:bash.0 Request processed in 10219us (10681us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384493.643407:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 142 00000100:00100000:0.0:1787384493.647184:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384493.647278:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173916544 00000100:00100000:2.0:1787384493.647293:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173916544 00000100:00100000:2.0:1787384493.647396:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 143 00000100:00100000:2.0:1787384493.647408:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3733d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+15:11329:x1874208173916544:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384493.647447:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384493.647469:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c3d27 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f04 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.647619:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d2e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.647634:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.647646:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.647702:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.647711:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.647719:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384493.648291:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787384493.648467:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648477:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648485:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648533:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d2e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648541:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d2e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648548:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648556:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384493.648561:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d2e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648568:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d2e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648580:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384493.648583:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384493.648587:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d2e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648592:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d2e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384493.648604:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e84385a1 reply state 000000003900ae69 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384493.648612:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787384493.648643:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c3d27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f04 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648667:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f04 expref: 17 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.648674:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e345695100) 00010000:00010000:2.0:1787384493.648677:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384493.648679:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2600, rc 0) 00000100:00100000:2.0:1787384493.648754:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3733d2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+18:11329:x1874208173916544:12345-192.168.203.51@tcp:101:bash.0 Request processed in 1348us (1583us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1787384493.648762:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 143 00000100:00100000:2.0:1787384493.653385:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384493.653545:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173916672 00000100:00100000:1.0:1787384493.653589:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173916672 00010000:00010000:3.0:1787384493.653700:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.653733:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.653755:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787384493.653761:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787384493.653762:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3e00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384493.653773:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.653781:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.653798:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e345695200) 00010000:00010000:3.0:1787384493.653802:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384493.653806:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.653812:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3d35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384493.653922:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:1.0:1787384493.653937:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+5:2352:x1874208173916672:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:1.0:1787384493.653963:0:10631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384493.654010:0:10631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c3d4a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f0b expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787384493.654045:0:10631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787384493.654072:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1787384493.654078:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384493.654089:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c3d4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f0b expref: 6 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.654110:0:10631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c3d4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f0b expref: 6 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.654125:0:10631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d800, rc 0) 00000100:00100000:1.0:1787384493.654206:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379eec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173916672:12345-192.168.203.51@tcp:101:bash.0 Request processed in 273us (829us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384493.654214:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:3.0:1787384493.657965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384493.658014:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173916800 00000100:00100000:3.0:1787384493.658023:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173916800 00000100:00100000:3.0:1787384493.658072:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:3.0:1787384493.658089:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+6:11329:x1874208173916800:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1787384493.658107:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384493.658126:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f12 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.658175:0:6574:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c3d4a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f0b expref: 7 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.658185:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384493.658189:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384493.658193:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 7 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.658227:0:6574:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c3d4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f0b expref: 7 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.658241:0:6574:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c3d4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f0b expref: 7 pid: 10631 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384493.658269:0:6574:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3731e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6574:1874208195944576:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384493.658378:0:6574:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4240 going to sleep for 11 seconds 00000100:00100000:0.0:1787384493.661363:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384493.661469:0:6574:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3731e4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6574:1874208195944576:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384493.661514:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 7 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.661541:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd600, rc 0) 00000100:00100000:3.0:1787384493.661615:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:11329:x1874208173916800:12345-192.168.203.51@tcp:101:bash.0 Request processed in 3527us (3660us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384493.661619:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173916928 00000100:00100000:3.0:1787384493.661626:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:1.0:1787384493.661628:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173916928 00010000:00010000:1.0:1787384493.661669:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c3d4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f0b expref: 7 pid: 10631 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384493.661708:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:1.0:1787384493.661719:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173916928:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384493.661742:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384493.661772:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c3d4a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f0b expref: 7 pid: 10631 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.661787:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c3d4a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f0b expref: 7 pid: 10631 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.661817:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c3d4a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f0b expref: 7 pid: 10631 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.661833:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384493.661838:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384493.661847:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 6 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.661885:0:7472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 6 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.661930:0:7472:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 6 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384493.661947:0:7472:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7472:1874208195944704:192.168.203.51@tcp:105: 00000100:00100000:1.0:1787384493.662195:0:7472:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aef000 going to sleep for 11 seconds 00000100:00100000:1.0:1787384493.673923:0:7472:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7472:1874208195944704:192.168.203.51@tcp:105: 00010000:00010000:1.0:1787384493.673964:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384493.674074:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173916928:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 12355us (12734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384493.674089:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:2.0:1787384493.680088:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384493.680277:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173917184 00000100:00100000:0.0:1787384493.680291:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173917184 00000100:00100000:0.0:1787384493.680367:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:0.0:1787384493.680379:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+17:11329:x1874208173917184:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:0.0:1787384493.681494:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+18:11329:x1874208173917184:12345-192.168.203.51@tcp:35:bash.0 Request processed in 1106us (1410us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1787384493.681529:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:0.0:1787384493.727677:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384493.727734:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384493.727854:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173917312 00000100:00100000:1.0:1787384493.727915:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173917312 00000100:00100000:1.0:1787384493.727991:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 298 00000100:00100000:1.0:1787384493.728016:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173917312:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384493.728111:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2351:x1874208173917312:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 97us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384493.728120:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 298 00000100:00100000:2.0:1787384493.728703:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173917440 00000100:00100000:2.0:1787384493.728711:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173917440 00000100:00100000:2.0:1787384493.728788:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00100000:2.0:1787384493.728797:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173917440:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384493.728853:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2351:x1874208173917440:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 57us (1117us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384493.728891:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00080000:1.0:1787384493.729347:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384493.796667:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384493.797107:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173917696 00000100:00100000:3.0:1787384493.797122:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173917696 00000100:00100000:3.0:1787384493.797277:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:3.0:1787384493.797289:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+18:11339:x1874208173917696:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384493.797337:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384493.797377:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3d58 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f19 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384493.797557:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787384493.797729:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3d58 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f19 expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.797747:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:3.0:1787384493.797750:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384493.797754:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3d58 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f19 expref: 20 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.797775:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fce00, rc 0) 00000100:00100000:3.0:1787384493.798247:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+19:11339:x1874208173917696:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 957us (1592us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1787384493.798265:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 144 00000100:00100000:0.0:1787384493.802485:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384493.802689:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173917952 00000100:00100000:2.0:1787384493.802702:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173917952 00000100:00100000:2.0:1787384493.803113:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:2.0:1787384493.803128:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+19:11339:x1874208173917952:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1787384493.803754:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+20:11339:x1874208173917952:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 628us (1281us total) trans 4294967421 rc 0/0 00000100:00100000:2.0:1787384493.804581:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:0.0:1787384493.921061:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384493.921195:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173918080 00000100:00100000:2.0:1787384493.921209:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173918080 00000100:00100000:2.0:1787384493.921325:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 145 00000100:00100000:2.0:1787384493.921337:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+20:11345:x1874208173918080:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384493.921382:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384493.921413:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d66 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f20 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.921505:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c3d6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.921521:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c3d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.921537:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c3d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384493.921616:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787384493.921620:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384493.921644:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c3d6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.921677:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d66 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f20 expref: 22 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.921697:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c3d6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f20 expref: 21 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.921733:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384493.921737:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384493.921741:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3600, rc 0) 00000100:00100000:2.0:1787384493.922015:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+21:11345:x1874208173918080:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 678us (966us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384493.922023:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 145 00000100:00100000:0.0:1787384493.927086:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384493.927199:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173918336 00000100:00100000:2.0:1787384493.927214:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173918336 00000100:00100000:2.0:1787384493.927306:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 146 00000100:00100000:2.0:1787384493.927318:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+21:11345:x1874208173918336:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384493.927356:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384493.927384:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f27 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.927531:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c3d7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.927548:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c3d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.927561:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c3d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384493.927575:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787384493.927755:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c3d74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f27 expref: 24 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.927818:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c3d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f27 expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.927829:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e345695100) 00010000:00010000:2.0:1787384493.927833:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384493.927836:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3c00, rc 0) 00000100:00100000:2.0:1787384493.928349:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+23:11345:x1874208173918336:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1024us (1272us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787384493.928358:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 146 00000100:00100000:3.0:1787384493.931306:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384493.931622:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173918464 00000100:00100000:1.0:1787384493.931636:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173918464 00000100:00100000:1.0:1787384493.931730:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:1.0:1787384493.931743:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+23:2353:x1874208173918464:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384493.931764:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384493.932167:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c3d7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f27 expref: 23 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.932202:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e345695100) 00010000:00010000:1.0:1787384493.932208:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384493.932302:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+22:2353:x1874208173918464:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 561us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384493.932310:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:2.0:1787384493.932444:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384493.932573:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173918720 00000100:00100000:1.0:1787384493.932580:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173918720 00000100:00100000:1.0:1787384493.932622:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 147 00000100:00100000:1.0:1787384493.932650:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+22:11345:x1874208173918720:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384493.932679:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384493.932698:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3d89 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f2e expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.932825:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3d90 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.932843:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3d90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.932856:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3d90 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384493.932914:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1787384493.933093:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3d89 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f2e expref: 25 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.933110:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3d90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f2e expref: 24 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.933119:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e345695100) 00010000:00010000:1.0:1787384493.933123:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787384493.933125:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624ca00, rc 0) 00000100:00100000:1.0:1787384493.933164:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+24:11345:x1874208173918720:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 515us (721us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1787384493.933171:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 147 00000100:00100000:2.0:1787384493.938749:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384493.938924:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173918848 00000100:00100000:1.0:1787384493.938937:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173918848 00000100:00100000:1.0:1787384493.939040:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:1.0:1787384493.939052:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+6:2352:x1874208173918848:12345-192.168.203.51@tcp:1:lfs.0 00010000:00010000:1.0:1787384493.939112:0:10631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.939139:0:10631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 6 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.939149:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787384493.939154:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384493.939159:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.939206:0:10631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 6 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.939221:0:10631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 6 pid: 6574 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384493.939240:0:10631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10631:1874208195944832:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384493.939397:0:10631:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aeff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787384493.943051:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384493.943195:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173918976 00000100:00100000:2.0:1787384493.943208:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173918976 00002000:00100000:2.0:1787384493.943283:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff89e3731e5f80 x1874208173918976/t0(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:524/0 lens 504/0 e 0 to 0 dl 1787384504 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787384493.943295:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e3731e5f80 with x1874208173918976 ext(0->12) 00010000:00010000:2.0:1787384493.943307:0:6580:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 7 pid: 6574 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.943326:0:6580:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 7 pid: 6574 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384493.943335:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89e3731e5f80 00000100:00100000:2.0:1787384493.943376:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:2.0:1787384493.943388:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173918976:12345-192.168.203.51@tcp:4:lfs.0 00000100:00100000:2.0:1787384493.944173:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddc9253f-47aa-4509-981d-645f91ec7250+9:2352:x1874208173918976:12345-192.168.203.51@tcp:4:lfs.0 Request processed in 781us (1131us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1787384493.944184:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00002000:00100000:2.0:1787384493.944194:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff89e3731e5f80 x1874208173918976/t4294967305(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:524/0 lens 504/448 e 0 to 0 dl 1787384504 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1787384493.944203:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e3731e5f80 with x1874208173918976 ext(0->12) 00010000:00010000:2.0:1787384493.944211:0:6580:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 9 pid: 6574 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.944225:0:6580:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 9 pid: 6574 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384493.944233:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff89e3731e5f80 00000100:00100000:1.0:1787384493.944449:0:10631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10631:1874208195944832:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384493.944483:0:10631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384493.947219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384493.947533:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173919104 00000100:00100000:3.0:1787384493.947547:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173919104 00010000:00010000:3.0:1787384493.947608:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 9 pid: 6574 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384493.947730:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:3.0:1787384493.947742:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:2353:x1874208173919104:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384493.947761:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787384493.947794:0:5770:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787384493.947798:0:5770:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787384492 00002000:00010000:3.0:1787384493.947800:0:5770:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787384493 00002000:00010000:3.0:1787384493.947803:0:5770:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787384492 00010000:00010000:3.0:1787384493.947810:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 9 pid: 6574 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.947824:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 9 pid: 6574 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.947909:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c3d51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f12 expref: 9 pid: 6574 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.947933:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384493.947938:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384493.947944:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.947956:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384493.948005:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384493.948091:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173919104:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 350us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384493.948105:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00010000:00010000:0.0:1787384493.948179:0:10631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.948190:0:10631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.948222:0:10631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.948231:0:10631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.948239:0:10631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.948246:0:10631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384493.948261:0:10631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.948285:0:10631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.948298:0:10631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.948306:0:10631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093de42b7/0x3522fbed3b6c3d9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384493.948362:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173918848:12345-192.168.203.51@tcp:1:lfs.0 Request processed in 9313us (9628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384493.948374:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:2.0:1787384493.951708:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384493.953034:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173919360 00000100:00100000:0.0:1787384493.953052:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173919360 00000100:00100000:0.0:1787384493.953266:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:0.0:1787384493.953279:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350fb9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+24:11345:x1874208173919360:12345-192.168.203.51@tcp:35:lfs.0 00000004:00010000:0.0:1787384493.953376:0:5787:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3d90 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f2e expref: 24 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384493.953896:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787384493.953952:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1787384493.955263:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1787384493.955367:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.955395:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f04 expref: 28 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.955415:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.955486:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f04 expref: 28 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.955597:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f04 expref: 28 pid: 5783 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384493.955618:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377f55180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1874208195944960:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384493.955820:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bcb480 going to sleep for 11 seconds 00000100:00100000:3.0:1787384493.960378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384493.960460:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173919488 00000100:00100000:1.0:1787384493.960491:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173919488 00010000:00010000:1.0:1787384493.960598:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f04 expref: 29 pid: 5783 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384493.960651:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:1.0:1787384493.960663:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+29:2352:x1874208173919488:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384493.960681:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384493.960689:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f04 expref: 29 pid: 5783 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.960705:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f04 expref: 29 pid: 5783 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.960733:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e345695100) 00010000:00010000:1.0:1787384493.960739:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.960749:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.960758:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.960950:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384493.961111:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+29:2352:x1874208173919488:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 448us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384493.961119:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 62 00010000:00010000:0.0:1787384493.962441:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c3d3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f04 expref: 28 pid: 5783 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384493.962469:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377f55180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1874208195944960:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384493.962704:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.962717:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384493.962724:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384493.963073:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1787384493.963336:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787384493.963479:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377f55180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195945088:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787384493.963661:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384493.963767:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bcb9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384493.964114:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195945088 00000100:00100000:2.0:1787384493.964125:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195945088 00000100:00100000:2.0:1787384493.964204:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384493.964215:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1874208195945088:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787384493.964317:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1874208195945088:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 104us (655us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384493.964326:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384493.964373:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377f55180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195945088:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787384493.965155:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1787384493.965243:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37273d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195945216:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787384493.965306:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384493.965357:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195945216 00000100:00100000:2.0:1787384493.965363:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195945216 00000100:00100000:2.0:1787384493.965392:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384493.965400:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5787:x1874208195945216:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787384493.965563:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbdbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5787:x1874208195945216:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 163us (256us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1787384493.965571:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384493.965594:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e345a2c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787384493.965621:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37273d880 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195945216:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787384493.965670:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1787384493.965711:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.965724:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.965732:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.965739:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384493.965744:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.965753:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.965772:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e345695100) 00010000:00010000:2.0:1787384493.965775:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00000100:00080000:1.0:1787384493.966063:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787384493.966126:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384493.966147:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3da5 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384493.966389:0:5787:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787384493.966511:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1787384493.966523:0:5787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355109662641ns, next at 356109660454ns, rc = 0 00000001:00080000:2.0:1787384493.966530:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1787384493.966571:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e345695100) 00010000:00010000:2.0:1787384493.966575:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787384493.966583:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3d90 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f2e expref: 32 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384493.966855:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350fb9050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+31:11345:x1874208173919360:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 13504us (15087us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1787384493.966889:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00000020:00080000:2.0:1787384493.966896:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787384493.970023:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384493.970096:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173919616 00000100:00100000:1.0:1787384493.970127:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173919616 00000100:00100000:1.0:1787384493.970202:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 148 00000100:00100000:1.0:1787384493.970215:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+31:11345:x1874208173919616:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384493.970261:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384493.970293:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3dac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f35 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.970379:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f35 expref: 32 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.970398:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3dac lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f35 expref: 32 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384493.970423:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:1.0:1787384493.970426:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384493.970430:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d800, rc 0) 00000100:00100000:1.0:1787384493.970742:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbda300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+32:11345:x1874208173919616:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 527us (732us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384493.970752:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 148 00000100:00100000:2.0:1787384493.974182:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384493.974286:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173919872 00000100:00100000:3.0:1787384493.974299:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173919872 00000100:00100000:3.0:1787384493.974375:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:3.0:1787384493.974387:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+32:11345:x1874208173919872:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1787384493.974709:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+33:11345:x1874208173919872:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 323us (540us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1787384493.974718:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:3.0:1787384494.057322:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384494.057694:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173920128 00000100:00100000:1.0:1787384494.057708:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173920128 00000100:00100000:1.0:1787384494.057851:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 149 00000100:00100000:1.0:1787384494.057905:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+33:11355:x1874208173920128:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384494.057940:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384494.057977:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3db3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f3c expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384494.058141:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787384494.058339:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3db3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f3c expref: 35 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.061916:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:1.0:1787384494.061923:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384494.061939:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3db3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f3c expref: 35 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.062044:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624da00, rc 0) 00000100:00100000:1.0:1787384494.062220:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+34:11355:x1874208173920128:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 4357us (4911us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1787384494.062231:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 149 00000100:00100000:2.0:1787384494.067573:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384494.067951:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173920256 00000100:00100000:0.0:1787384494.067974:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173920256 00000100:00100000:0.0:1787384494.068054:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 150 00000100:00100000:0.0:1787384494.068066:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+34:11355:x1874208173920256:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:0.0:1787384494.068167:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3dc1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.068187:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.068201:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.068221:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3dc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.068229:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.068235:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.068448:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.068458:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.068465:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384494.068750:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.068766:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3dc1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.068773:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3dc1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069049:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3dc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069056:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384494.069061:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3dc1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069070:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3dc1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069085:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:0.0:1787384494.069089:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384494.069094:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3dc1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069101:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3dc1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069117:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069124:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3dc8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069141:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069147:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108bc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384494.069150:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069156:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3dc8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069165:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e343ce4600) 00010000:00010000:0.0:1787384494.069167:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384494.069171:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3dc8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069177:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3dc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069193:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069199:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069205:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069210:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384494.069213:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069230:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069238:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384494.069241:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384494.069244:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.069259:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3dcf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384494.069376:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbdb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+34:11355:x1874208173920256:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 1308us (1816us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384494.069387:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 150 00000100:00100000:3.0:1787384494.071625:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384494.076142:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173920512 00000100:00100000:2.0:1787384494.076163:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173920512 00000100:00100000:2.0:1787384494.076259:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:2.0:1787384494.076272:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+34:11355:x1874208173920512:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1787384494.076706:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+35:11355:x1874208173920512:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 435us (5090us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787384494.076716:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00010000:00010000:2.0:1787384494.089083:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384494.110851:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384494.111227:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173920768 00000100:00100000:2.0:1787384494.111242:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173920768 00000100:00100000:2.0:1787384494.111365:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 151 00000100:00100000:2.0:1787384494.111379:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+35:11358:x1874208173920768:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384494.111421:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384494.111451:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c3dd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f43 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.111558:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3ddd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.111575:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3ddd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.111590:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3ddd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.111609:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c3de4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.111616:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c3de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.111623:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c3de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112122:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112134:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112168:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384494.112182:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787384494.112324:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3ddd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112332:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3ddd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112340:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3ddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112346:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384494.112352:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3ddd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112360:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3ddd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112375:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384494.112378:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384494.112384:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3ddd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112390:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3ddd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112405:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c3de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112412:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c3de4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112426:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c3de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112431:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384494.112435:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c3de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112442:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c3de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112450:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e345695100) 00010000:00010000:2.0:1787384494.112453:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384494.112455:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c3de4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112461:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c3de4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112676:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c3dd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f43 expref: 38 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112692:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f43 expref: 37 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.112700:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:2.0:1787384494.112702:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384494.112704:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2a00, rc 0) 00000100:00100000:2.0:1787384494.112957:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+37:11358:x1874208173920768:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1581us (2173us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1787384494.112987:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 151 00000100:00100000:1.0:1787384494.116339:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384494.116404:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173920896 00000100:00100000:3.0:1787384494.116418:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173920896 00000100:00100000:3.0:1787384494.116486:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 152 00000100:00100000:3.0:1787384494.116495:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+37:11358:x1874208173920896:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:3.0:1787384494.116587:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.116612:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.116626:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.116664:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.116695:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3df9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.116700:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.116705:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384494.116708:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.116714:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3df9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.116725:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:3.0:1787384494.116728:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384494.116731:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3df9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.116735:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384494.117090:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+37:11358:x1874208173920896:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 583us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384494.117100:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 152 00000100:00100000:3.0:1787384494.119459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384494.119564:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173921152 00000100:00100000:2.0:1787384494.119575:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173921152 00000100:00100000:2.0:1787384494.119638:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:2.0:1787384494.119651:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+37:11358:x1874208173921152:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1787384494.120135:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+38:11358:x1874208173921152:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 484us (684us total) trans 4294967437 rc 0/0 00000100:00100000:2.0:1787384494.120145:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:1.0:1787384494.483046:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384494.483337:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173921408 00000100:00100000:0.0:1787384494.483351:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173921408 00000100:00100000:0.0:1787384494.483430:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 153 00000100:00100000:0.0:1787384494.483442:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+38:11389:x1874208173921408:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:0.0:1787384494.483475:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384494.483502:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e00 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f4a expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.483639:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.483657:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.483696:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384494.483712:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787384494.483933:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e00 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f4a expref: 41 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.483956:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f4a expref: 40 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.483965:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384494.483969:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384494.483974:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108bc00, rc 0) 00000100:00100000:0.0:1787384494.484111:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+40:11389:x1874208173921408:12345-192.168.203.51@tcp:101:cat.0 Request processed in 670us (1086us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787384494.484120:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 153 00000100:00100000:1.0:1787384494.490840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384494.491088:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173921536 00000100:00100000:0.0:1787384494.491102:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173921536 00000100:00100000:0.0:1787384494.491203:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:0.0:1787384494.491216:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+40:2352:x1874208173921536:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384494.491237:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384494.491283:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f4a expref: 40 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.491306:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384494.491312:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384494.491409:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+39:2352:x1874208173921536:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 194us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384494.491417:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:3.0:1787384494.505580:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384494.506150:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173921792 00000100:00100000:2.0:1787384494.506173:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173921792 00000100:00100000:2.0:1787384494.506261:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:2.0:1787384494.506273:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+39:11389:x1874208173921792:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:2.0:1787384494.506689:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+40:11389:x1874208173921792:12345-192.168.203.51@tcp:35:cat.0 Request processed in 417us (1120us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787384494.506700:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:1.0:1787384494.571605:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384494.572188:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173922048 00000100:00100000:0.0:1787384494.572203:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173922048 00000100:00100000:0.0:1787384494.572300:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 154 00000100:00100000:0.0:1787384494.572313:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+40:11395:x1874208173922048:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:0.0:1787384494.572345:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384494.572350:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787384494.572391:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c3d6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f20 expref: 40 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.572419:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:0.0:1787384494.572426:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384494.572444:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e15 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f51 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.572631:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.572649:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f43 expref: 40 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.572660:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.572703:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f43 expref: 40 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.572733:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f43 expref: 40 pid: 5783 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384494.572751:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377f57800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195945344:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384494.572971:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bcba80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384494.577361:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377f57800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195945344:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384494.577423:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384494.584960:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384494.585058:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173922176 00000100:00100000:2.0:1787384494.585074:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173922176 00010000:00010000:2.0:1787384494.585131:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f43 expref: 41 pid: 5783 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384494.585192:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:2.0:1787384494.585203:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+41:2353:x1874208173922176:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384494.585221:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384494.585228:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f43 expref: 41 pid: 5783 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.585277:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f43 expref: 41 pid: 5783 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.585304:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c3deb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f43 expref: 41 pid: 5783 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.585324:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:2.0:1787384494.585330:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.585340:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.585349:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.585385:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384494.585460:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441dac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+40:2353:x1874208173922176:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 259us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384494.585470:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00010000:00010000:0.0:1787384494.585791:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.585802:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384494.585835:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787384494.586107:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f51 expref: 41 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.586129:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f51 expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.586138:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384494.586142:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384494.586144:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b000, rc 0) 00000100:00100000:0.0:1787384494.586204:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+40:11395:x1874208173922048:12345-192.168.203.51@tcp:101:dd.0 Request processed in 13894us (14615us total) trans 4294967440 rc 0/0 00000100:00100000:0.0:1787384494.586225:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 154 00000100:00100000:1.0:1787384494.590855:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384494.591527:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173922432 00000100:00100000:2.0:1787384494.591541:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173922432 00000100:00100000:2.0:1787384494.591622:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 155 00000100:00100000:2.0:1787384494.591635:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+40:11395:x1874208173922432:12345-192.168.203.51@tcp:36:dd.0 00010000:00010000:2.0:1787384494.592035:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.592058:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384494.592092:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384494.592716:0:5783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:2.0:1787384494.592771:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cff4cf58 reply state 00000000b1f3b2d8 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384494.592784:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384494.593222:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+43:11395:x1874208173922432:12345-192.168.203.51@tcp:36:dd.0 Request processed in 1585us (2454us total) trans 4294967442 rc 0/0 00000100:00100000:2.0:1787384494.593233:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 155 00000020:00080000:2.0:1787384494.593240:0:5783:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787384494.599651:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.599676:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.599708:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.599715:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384494.599721:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.599731:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.599755:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:3.0:1787384494.599759:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384494.599984:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.599994:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c3e2a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384494.930965:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384494.931150:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173922560 00000100:00100000:3.0:1787384494.931164:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173922560 00000100:00100000:3.0:1787384494.931259:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 156 00000100:00100000:3.0:1787384494.931271:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+42:11409:x1874208173922560:12345-192.168.203.51@tcp:101:stat.0 00010000:00010000:3.0:1787384494.931308:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384494.931337:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3e31 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f58 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931426:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3e38 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931442:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3e38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931479:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3e38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931497:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931505:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931512:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931636:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931650:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f51 expref: 43 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931659:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931704:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f51 expref: 43 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384494.931720:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f51 expref: 43 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384494.931737:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3731e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195945472:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384494.932410:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4240 going to sleep for 11 seconds 00000100:00100000:2.0:1787384494.948777:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384494.949052:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173922816 00000100:00100000:0.0:1787384494.949068:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173922816 00000100:00100000:0.0:1787384494.949146:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:0.0:1787384494.949158:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+44:5565:x1874208173922816:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787384494.949605:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+45:5565:x1874208173922816:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 446us (850us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1787384494.949615:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:3.0:1787384494.950750:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3731e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195945472:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384494.950807:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384494.955614:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384494.956011:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173922944 00000100:00100000:0.0:1787384494.956026:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173922944 00010000:00010000:0.0:1787384494.956086:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f51 expref: 45 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384494.956134:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:0.0:1787384494.956146:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+45:2352:x1874208173922944:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384494.956164:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384494.956173:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f51 expref: 45 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.956188:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f51 expref: 45 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.956218:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e1c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f51 expref: 45 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.956253:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384494.956283:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.956297:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.956308:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384494.956355:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384494.956430:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+44:2352:x1874208173922944:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 286us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384494.956440:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00010000:00010000:1.0:1787384494.956529:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956539:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384494.956602:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787384494.956608:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787384494.956641:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956669:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956680:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3e38 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956687:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3e38 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956695:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3e38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956702:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fce00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384494.956706:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3e38 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956715:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3e38 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956726:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:1.0:1787384494.956729:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384494.956733:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3e38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956739:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3e38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956754:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956761:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3e3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956791:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956797:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fdc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384494.956800:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956807:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3e3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956817:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e34836a200) 00010000:00010000:1.0:1787384494.956821:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384494.956824:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3e3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956830:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956959:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3e31 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f58 expref: 44 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956977:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f58 expref: 43 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384494.956984:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:1.0:1787384494.956987:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384494.956990:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd400, rc 0) 00000100:00100000:1.0:1787384494.957028:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+43:11409:x1874208173922560:12345-192.168.203.51@tcp:101:stat.0 Request processed in 25759us (26077us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384494.957046:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 156 00000100:00100000:1.0:1787384495.025804:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.026073:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173923200 00000100:00100000:0.0:1787384495.026089:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173923200 00000100:00100000:0.0:1787384495.026199:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 157 00000100:00100000:0.0:1787384495.026218:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+43:11415:x1874208173923200:12345-192.168.203.51@tcp:36:truncate.0 00010000:00010000:0.0:1787384495.026321:0:7691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384495.026364:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e46 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f58 expref: 43 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.026391:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384495.026398:0:7691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384495.026768:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787384495.026898:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787384495.027351:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.027369:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384495.027495:0:7691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1787384495.027556:0:7691:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000027abd812 reply state 000000001867aec0 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384495.027568:0:7691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384495.027740:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+45:11415:x1874208173923200:12345-192.168.203.51@tcp:36:truncate.0 Request processed in 1526us (1947us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1787384495.027750:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 157 00000020:00080000:0.0:1787384495.027757:0:7691:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787384495.030909:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.030933:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.030941:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.030948:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384495.030954:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.030974:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.030997:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:3.0:1787384495.031000:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384495.031007:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.031013:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e4d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.113142:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384495.221443:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.221563:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173923328 00000100:00100000:0.0:1787384495.221578:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173923328 00000100:00100000:0.0:1787384495.221655:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 158 00000100:00100000:0.0:1787384495.221667:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+44:11429:x1874208173923328:12345-192.168.203.51@tcp:101:stat.0 00010000:00010000:0.0:1787384495.221700:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384495.221728:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e54 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f5f expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.221835:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.221853:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.221910:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.221928:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222147:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222154:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222304:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222315:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222323:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384495.222375:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1787384495.222381:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384495.222411:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222426:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222436:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222444:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e5b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222450:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222470:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384495.222475:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222484:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e5b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222500:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:0.0:1787384495.222503:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384495.222508:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e5b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222514:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222531:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222537:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222543:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222549:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384495.222552:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222557:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222575:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e343ce4600) 00010000:00010000:0.0:1787384495.222578:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384495.222581:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e62 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222588:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222626:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e54 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f5f expref: 46 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222642:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f5f expref: 45 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.222651:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384495.222653:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384495.222656:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b400, rc 0) 00000100:00100000:0.0:1787384495.222755:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+45:11429:x1874208173923328:12345-192.168.203.51@tcp:101:stat.0 Request processed in 1090us (1325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384495.222764:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 158 00000100:00100000:2.0:1787384495.296710:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.296841:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173923584 00000100:00100000:0.0:1787384495.296905:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173923584 00000100:00100000:0.0:1787384495.297099:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 159 00000100:00100000:0.0:1787384495.297111:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+45:11439:x1874208173923584:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384495.297138:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384495.297163:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e70 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f66 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384495.297351:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787384495.297495:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e70 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f66 expref: 47 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.297513:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:0.0:1787384495.297516:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384495.297521:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e70 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f66 expref: 47 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.297537:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108bc00, rc 0) 00000100:00100000:0.0:1787384495.297617:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+46:11439:x1874208173923584:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 508us (921us total) trans 4294967446 rc 301/301 00000100:00100000:0.0:1787384495.297626:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 159 00000100:00100000:2.0:1787384495.301525:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.301694:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173923840 00000100:00100000:0.0:1787384495.301708:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173923840 00000100:00100000:0.0:1787384495.301792:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:0.0:1787384495.301804:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350fb8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+46:11439:x1874208173923840:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1787384495.302449:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350fb8450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+47:11439:x1874208173923840:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 644us (944us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1787384495.302459:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:2.0:1787384495.351730:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.351912:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173924096 00000100:00100000:0.0:1787384495.351927:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173924096 00000100:00100000:0.0:1787384495.352013:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 160 00000100:00100000:0.0:1787384495.352025:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+47:11445:x1874208173924096:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1787384495.352058:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384495.352104:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e7e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f6d expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.352257:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.352276:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f5f expref: 48 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.352288:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.352342:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f5f expref: 48 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.352359:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f5f expref: 48 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384495.352377:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377f57800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195945600:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384495.352520:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bcba80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384495.356934:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.357099:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377f57800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195945600:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384495.357137:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384495.357369:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173924224 00000100:00100000:2.0:1787384495.357379:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173924224 00010000:00010000:2.0:1787384495.357428:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f5f expref: 49 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384495.357592:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:2.0:1787384495.357605:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+49:2353:x1874208173924224:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384495.357626:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384495.357634:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f5f expref: 49 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.357671:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f5f expref: 49 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.357705:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3e69 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f5f expref: 49 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.357726:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:2.0:1787384495.357732:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.357743:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.357752:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.357822:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384495.357959:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+48:2353:x1874208173924224:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 355us (1039us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384495.357967:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00010000:00010000:0.0:1787384495.358274:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.358284:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384495.358321:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:0.0:1787384495.359020:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3e7e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f6d expref: 49 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.359046:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f6d expref: 48 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.359055:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384495.359059:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384495.359062:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b000, rc 0) 00000100:00100000:0.0:1787384495.359197:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+48:11445:x1874208173924096:12345-192.168.203.51@tcp:101:bash.0 Request processed in 7173us (7484us total) trans 4294967448 rc 0/0 00000100:00100000:0.0:1787384495.359209:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 160 00000100:00100000:1.0:1787384495.362590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.362761:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173924480 00000100:00100000:0.0:1787384495.362997:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173924480 00000100:00100000:0.0:1787384495.363086:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 161 00000100:00100000:0.0:1787384495.363100:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+48:11445:x1874208173924480:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:0.0:1787384495.363479:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.363502:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.363519:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384495.363576:0:5783:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1787384495.363616:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007ec2f2f1 reply state 00000000ac5c41ee transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384495.363627:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384495.363745:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+51:11445:x1874208173924480:12345-192.168.203.51@tcp:36:bash.0 Request processed in 646us (1168us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787384495.363754:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 161 00000020:00080000:0.0:1787384495.363761:0:5783:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787384495.366115:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.366139:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.366149:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.366155:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384495.366161:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.366169:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.366190:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384495.366194:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384495.366199:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.366205:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3e93 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384495.370556:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384495.370655:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173924608 00000100:00100000:3.0:1787384495.370672:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173924608 00000100:00100000:3.0:1787384495.370751:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 162 00000100:00100000:3.0:1787384495.370789:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+50:11445:x1874208173924608:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1787384495.370824:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384495.370853:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f74 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.371151:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.371174:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f6d expref: 51 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.371185:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.371235:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f6d expref: 51 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384495.371263:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f6d expref: 51 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384495.371282:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3731e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195945728:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384495.371395:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4240 going to sleep for 11 seconds 00000100:00100000:3.0:1787384495.374599:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384495.374816:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3731e4e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195945728:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384495.374898:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384495.375039:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173924736 00000100:00100000:0.0:1787384495.375068:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173924736 00010000:00010000:0.0:1787384495.375124:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f6d expref: 52 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384495.375185:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:0.0:1787384495.375198:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+52:2353:x1874208173924736:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384495.375222:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384495.375231:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f6d expref: 52 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.375253:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f6d expref: 52 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.375580:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3e85 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f6d expref: 52 pid: 5784 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.375606:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384495.375612:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.375625:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.375634:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.375718:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384495.375801:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+51:2353:x1874208173924736:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 603us (1220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384495.375826:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 66 00010000:00010000:1.0:1787384495.379628:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.379652:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384495.379731:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787384495.379737:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787384495.379765:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.379829:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c3e9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f74 expref: 51 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.382671:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f74 expref: 50 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.382695:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:1.0:1787384495.382723:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384495.382727:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd200, rc 0) 00000100:00100000:1.0:1787384495.382945:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+50:11445:x1874208173924608:12345-192.168.203.51@tcp:101:bash.0 Request processed in 12156us (12403us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384495.382957:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 162 00000100:00100000:3.0:1787384495.389454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384495.389597:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173924992 00000100:00100000:2.0:1787384495.389612:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173924992 00000100:00100000:2.0:1787384495.389762:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:2.0:1787384495.389787:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+50:11445:x1874208173924992:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:2.0:1787384495.390159:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+51:11445:x1874208173924992:12345-192.168.203.51@tcp:35:bash.0 Request processed in 375us (721us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1787384495.390169:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:2.0:1787384495.496376:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384495.496522:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173925248 00000100:00100000:1.0:1787384495.496537:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173925248 00000100:00100000:1.0:1787384495.496719:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 163 00000100:00100000:1.0:1787384495.496732:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+51:11455:x1874208173925248:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384495.496764:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384495.496800:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3ea8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f7b expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384495.497380:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1787384495.497550:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3ea8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f7b expref: 53 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.497568:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:1.0:1787384495.497572:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384495.497578:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3ea8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f7b expref: 53 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.497595:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624dc00, rc 0) 00000100:00100000:1.0:1787384495.497991:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+52:11455:x1874208173925248:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1258us (1625us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1787384495.498001:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 163 00000100:00100000:1.0:1787384495.503335:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.503597:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173925376 00000100:00100000:0.0:1787384495.503622:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173925376 00000100:00100000:0.0:1787384495.503709:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 164 00000100:00100000:0.0:1787384495.503722:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+52:11455:x1874208173925376:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:0.0:1787384495.503854:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3eb6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.503917:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.503931:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.503952:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.503961:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.503968:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504104:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504116:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504123:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384495.504540:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504562:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3eb6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504569:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3eb6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504575:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504582:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384495.504587:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3eb6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504595:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3eb6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504611:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:0.0:1787384495.504615:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384495.504621:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3eb6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504628:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3eb6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504655:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504660:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ebd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504675:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504681:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384495.504684:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504690:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504699:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e343ce4600) 00010000:00010000:0.0:1787384495.504701:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384495.504705:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ebd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504711:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504728:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504734:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504739:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504743:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108bc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384495.504746:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.504762:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.505071:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384495.505074:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384495.505078:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.505084:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ec4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384495.505201:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+52:11455:x1874208173925376:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 1477us (1875us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384495.506083:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 164 00000100:00100000:3.0:1787384495.511378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.511667:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173925632 00000100:00100000:0.0:1787384495.511680:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173925632 00000100:00100000:0.0:1787384495.511752:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:0.0:1787384495.511764:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+52:11455:x1874208173925632:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1787384495.512158:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+53:11455:x1874208173925632:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 394us (794us total) trans 4294967453 rc 0/0 00000100:00100000:0.0:1787384495.512166:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:3.0:1787384495.569380:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.569539:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173925888 00000100:00100000:0.0:1787384495.569553:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173925888 00000100:00100000:0.0:1787384495.569653:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 165 00000100:00100000:0.0:1787384495.569666:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+53:11458:x1874208173925888:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384495.569708:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384495.569741:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ecb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f82 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.570494:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ed2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.570516:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.570531:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.570549:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3ed9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.570557:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.570564:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.571463:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3ee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.571529:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.571543:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384495.571556:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1787384495.571989:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ed2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.571998:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ed2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572022:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ed2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572028:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384495.572034:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ed2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572043:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ed2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572185:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:0.0:1787384495.572190:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384495.572196:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572329:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3ed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572349:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3ed9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572355:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3ed9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572361:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572365:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384495.572368:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3ed9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572385:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3ed9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572394:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e343ce4600) 00010000:00010000:0.0:1787384495.572397:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384495.572399:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3ed9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572405:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3ed9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572469:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3ecb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f82 expref: 56 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572736:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f82 expref: 55 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.572746:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384495.572748:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384495.572751:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108aa00, rc 0) 00000100:00100000:0.0:1787384495.573119:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+55:11458:x1874208173925888:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 3454us (3753us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1787384495.573130:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 165 00000100:00100000:1.0:1787384495.580473:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384495.580535:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.580648:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173926144 00000100:00100000:0.0:1787384495.580662:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173926144 00000100:00100000:0.0:1787384495.580752:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 166 00000100:00100000:0.0:1787384495.580766:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+55:11458:x1874208173926144:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:0.0:1787384495.580958:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3eee lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.580981:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.580994:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.581484:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3eee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.581494:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3eee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.581502:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.581509:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108bc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384495.581513:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3eee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.581521:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3eee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.581540:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:0.0:1787384495.581543:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384495.581548:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3eee lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384495.581554:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3eee lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384495.581685:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+55:11458:x1874208173926144:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 918us (1145us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384495.581697:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 166 00000100:00100000:2.0:1787384495.583746:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173926016 00000100:00100000:2.0:1787384495.583773:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173926016 00000100:00100000:2.0:1787384495.583895:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:2.0:1787384495.583907:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+55:2350:x1874208173926016:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384495.583926:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384495.583959:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3ee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f82 expref: 55 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.583986:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:2.0:1787384495.583992:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384495.584073:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+54:2350:x1874208173926016:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 167us (3613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384495.584082:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:1.0:1787384495.590669:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384495.593587:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173926400 00000100:00100000:0.0:1787384495.601935:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173926400 00000100:00100000:1.0:1787384495.602672:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:1.0:1787384495.602688:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+54:11458:x1874208173926400:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1787384495.603102:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+55:11458:x1874208173926400:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 415us (12444us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1787384495.603112:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 47 00000004:00080000:3.0:1787384495.689880:0:6654:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356832996165ns, next at 357832993089ns, rc = 0 00000100:00100000:1.0:1787384495.690069:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3731e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195945856:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384495.690182:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384495.690833:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195945856 00000100:00100000:3.0:1787384495.690884:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195945856 00000100:00100000:3.0:1787384495.691401:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787384495.691418:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195945856:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384495.691455:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384495.691559:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195945856:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384495.691568:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:1.0:1787384495.692080:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384495.692190:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3731e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195945856:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384495.819020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384495.822578:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173926656 00000100:00100000:1.0:1787384495.822600:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173926656 00000100:00100000:1.0:1787384495.822700:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 167 00000100:00100000:1.0:1787384495.822713:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+55:11476:x1874208173926656:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:1.0:1787384495.822746:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384495.822772:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ef5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f89 expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.822955:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3efc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.822972:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.822986:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3efc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384495.823024:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787384495.823191:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3ef5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f89 expref: 58 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.824392:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3efc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f89 expref: 57 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.824414:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:1.0:1787384495.824417:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787384495.824422:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d600, rc 0) 00000100:00100000:1.0:1787384495.824548:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+57:11476:x1874208173926656:12345-192.168.203.51@tcp:101:cat.0 Request processed in 1833us (5539us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1787384495.824559:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 167 00000100:00100000:0.0:1787384495.845183:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384495.846639:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173926784 00000100:00100000:2.0:1787384495.846661:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173926784 00000100:00100000:2.0:1787384495.846767:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 168 00000100:00100000:2.0:1787384495.846780:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+57:11477:x1874208173926784:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384495.846824:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384495.846855:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c3f0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f90 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.846987:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c3f11 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.847005:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c3f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.847037:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c3f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384495.847115:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787384495.847120:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384495.847147:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c3f11 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.847180:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c3f0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f90 expref: 59 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.847202:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c3f11 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f90 expref: 58 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.847212:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384495.847216:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384495.847220:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3200, rc 0) 00000100:00100000:2.0:1787384495.847333:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+58:11477:x1874208173926784:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 556us (2165us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384495.847342:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 168 00000100:00100000:3.0:1787384495.851716:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384495.851946:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173927168 00000100:00100000:1.0:1787384495.851961:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173927168 00000100:00100000:1.0:1787384495.852044:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:1.0:1787384495.852056:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+58:11477:x1874208173927168:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1787384495.852856:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+59:11477:x1874208173927168:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 799us (1152us total) trans 4294967457 rc 0/0 00000100:00100000:1.0:1787384495.852901:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:3.0:1787384495.857002:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384495.857098:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173927296 00000100:00100000:2.0:1787384495.857114:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173927296 00000100:00100000:2.0:1787384495.857201:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1787384495.857213:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+59:11477:x1874208173927296:12345-192.168.203.51@tcp:103:lfs.0 00010000:00010000:2.0:1787384495.857240:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1787384495.857273:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3ea1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f74 expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.857327:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3efc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f89 expref: 58 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.857338:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3dac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f35 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384495.857347:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919a00) 00010000:00010000:2.0:1787384495.857362:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384495.857435:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+56:11477:x1874208173927296:12345-192.168.203.51@tcp:103:lfs.0 Request processed in 224us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384495.857444:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:0.0:1787384495.865598:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384495.865791:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173927424 00000100:00100000:1.0:1787384495.865805:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173927424 00000100:00100000:1.0:1787384495.865925:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 169 00000100:00100000:1.0:1787384495.865937:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+56:11477:x1874208173927424:12345-192.168.203.51@tcp:58:lfs.0 00010000:00010000:1.0:1787384495.866388:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3f18 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.866419:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3f18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.866436:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3f18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787384495.866839:0:7691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:1.0:1787384495.867544:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+56:11477:x1874208173927424:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 1602us (1957us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384495.867701:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 169 00000100:00100000:3.0:1787384495.892978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384495.893383:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173927552 00000100:00100000:1.0:1787384495.893397:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173927552 00000100:00100000:1.0:1787384495.893602:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 170 00000100:00100000:1.0:1787384495.893614:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+56:11479:x1874208173927552:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384495.893643:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384495.893672:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3f1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f97 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.893759:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f26 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.893777:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.893791:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.893807:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.893839:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.893845:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.896826:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.896853:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.896894:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384495.896949:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787384495.896953:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787384495.896977:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.896990:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897000:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f26 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897008:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f26 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897016:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897044:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384495.897050:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f26 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897058:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f26 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897073:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:1.0:1787384495.897076:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384495.897080:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f26 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897087:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f26 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897102:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897107:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897114:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897119:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624dc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384495.897122:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897127:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897145:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e346919100) 00010000:00010000:1.0:1787384495.897147:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384495.897150:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f2d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897155:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897204:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d800/0x3522fbed3b6c3f1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f97 expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897230:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f97 expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384495.897245:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919800) 00010000:00010000:1.0:1787384495.897247:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384495.897249:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624da00, rc 0) 00000100:00100000:1.0:1787384495.897343:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+57:11479:x1874208173927552:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 3730us (4379us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384495.897352:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 170 00010000:00010000:2.0:1787384496.138327:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787384496.201226:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384496.201250:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384496.201343:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787384496.201357:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384496.201538:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377f56680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195945984:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787384496.201674:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bcbd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787384496.204473:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195946112:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.204482:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195946240:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.204749:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e34306ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195946496:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.204988:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384496.205031:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195946752:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.205062:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384496.205094:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384496.205101:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195946368:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.205125:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384496.205170:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195946752 00000100:00100000:2.0:1787384496.205182:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195946752 00000100:00100000:2.0:1787384496.205262:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787384496.205273:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195946752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.205338:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195946752:12345-0@lo:400:kworker.0 Request processed in 67us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.205364:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787384496.205396:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195946240 00000100:00100000:2.0:1787384496.205400:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195946240 00000100:00100000:2.0:1787384496.205423:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195946368 00000100:00100000:2.0:1787384496.205425:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195946368 00000100:00100000:2.0:1787384496.205444:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787384496.205450:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195946240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.205502:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195946240:12345-0@lo:400:kworker.0 Request processed in 52us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.205511:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1787384496.205523:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1787384496.205529:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195946368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.205555:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195946368:12345-0@lo:400:kworker.0 Request processed in 26us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.205562:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00080000:2.0:1787384496.205886:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384496.205893:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384496.205941:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343068000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195946368:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.205954:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195946240:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.205965:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343068380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195946752:0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.210010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384496.211082:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195946496 00000100:00100000:3.0:1787384496.211108:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195946496 00000100:00100000:3.0:1787384496.211194:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787384496.211207:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195946496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384496.211350:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195946496:12345-0@lo:400:kworker.0 Request processed in 141us (1349us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384496.211358:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787384496.211688:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e34306ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195946496:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.216916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384496.217212:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195946112 00000100:00100000:3.0:1787384496.217225:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195946112 00000100:00100000:3.0:1787384496.217307:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787384496.217318:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195946112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384496.217756:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195946112:12345-0@lo:400:kworker.0 Request processed in 438us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384496.217775:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1787384496.217979:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195946112:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.218000:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195946624:0@lo:400:kworker.0 00000100:00100000:2.0:1787384496.218064:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384496.218197:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195946624 00000100:00100000:1.0:1787384496.218203:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195946624 00000100:00100000:1.0:1787384496.218272:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787384496.218285:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195946624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384496.218332:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195946624:12345-0@lo:400:kworker.0 Request processed in 52us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.218346:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787384496.218492:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195946624:0@lo:400:kworker.0 00000100:00080000:3.0:1787384496.219176:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384496.230714:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377f56680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195945984:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787384496.233313:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384496.234346:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173927680 00000100:00100000:2.0:1787384496.234364:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173927680 00000100:00100000:2.0:1787384496.234449:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 171 00000100:00100000:2.0:1787384496.234462:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+57:11490:x1874208173927680:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787384496.234530:0:5785:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787384496.234712:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+57:11490:x1874208173927680:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 252us (1414us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.234721:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 171 00000100:00100000:2.0:1787384496.249302:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384496.249557:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173927808 00000100:00100000:1.0:1787384496.249570:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173927808 00000100:00100000:1.0:1787384496.249661:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 172 00000100:00100000:1.0:1787384496.249674:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+57:11490:x1874208173927808:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1787384496.249796:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f3b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.249818:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.249833:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.249852:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.249901:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.249910:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.249944:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.249964:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.249970:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384496.250041:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1787384496.250047:0:7691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787384496.250062:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250075:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f3b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250081:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f3b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250088:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250105:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624dc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384496.250111:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f3b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250120:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f3b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250133:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:1.0:1787384496.250136:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384496.250142:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f3b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250147:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f3b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250162:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250178:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f42 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250184:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250189:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384496.250192:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250198:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f42 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250206:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff89e346919100) 00010000:00010000:1.0:1787384496.250209:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384496.250211:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f42 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250217:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250244:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250250:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250256:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250261:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384496.250272:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250279:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250287:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919800) 00010000:00010000:1.0:1787384496.250289:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384496.250292:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.250297:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c3f49 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384496.250402:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+57:11490:x1874208173927808:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 728us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.250412:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 172 00000100:00100000:0.0:1787384496.266743:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384496.270675:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173928064 00000100:00100000:1.0:1787384496.270699:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173928064 00000100:00100000:1.0:1787384496.271242:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 173 00000100:00100000:1.0:1787384496.271255:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+57:11490:x1874208173928064:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384496.271282:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384496.271313:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f50 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78f9e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271474:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f57 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271495:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271549:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384496.271564:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1787384496.271705:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f57 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271714:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f57 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271721:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271728:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624dc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384496.271734:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f57 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271741:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f57 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271754:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919800) 00010000:00010000:1.0:1787384496.271757:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384496.271762:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f57 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271767:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c3f57 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271819:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f50 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f9e expref: 59 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271843:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:1.0:1787384496.271846:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384496.271850:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c3f50 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f9e expref: 59 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.271916:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d600, rc 0) 00000100:00100000:1.0:1787384496.276230:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+58:11490:x1874208173928064:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 4959us (9484us total) trans 4294967458 rc 301/301 00000100:00100000:1.0:1787384496.276257:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 173 00000100:00100000:1.0:1787384496.289719:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384496.290326:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173928192 00000100:00100000:3.0:1787384496.290349:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173928192 00000100:00100000:3.0:1787384496.290465:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 174 00000100:00100000:3.0:1787384496.290478:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+58:11490:x1874208173928192:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787384496.290545:0:7691:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787384496.290701:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+58:11490:x1874208173928192:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 225us (999us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384496.290710:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 174 00000100:00100000:1.0:1787384496.308588:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384496.310544:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173928448 00000100:00100000:0.0:1787384496.310567:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173928448 00000100:00100000:0.0:1787384496.310667:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 175 00000100:00100000:0.0:1787384496.310681:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+58:11490:x1874208173928448:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384496.310715:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384496.310720:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787384496.310757:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c3f11 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f90 expref: 58 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.310805:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:0.0:1787384496.310811:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384496.310830:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3f65 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78fa5 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787384496.311624:0:5785:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:0.0:1787384496.311949:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3f6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.311968:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.311980:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3f6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.314905:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3f65 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fa5 expref: 60 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.314953:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3f6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fa5 expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.314965:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4600) 00010000:00010000:0.0:1787384496.314968:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384496.314973:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ac00, rc 0) 00000100:00100000:0.0:1787384496.315219:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+59:11490:x1874208173928448:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 4538us (6644us total) trans 4294967459 rc 0/0 00000100:00100000:0.0:1787384496.315241:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 175 00000100:00100000:1.0:1787384496.324230:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384496.326124:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173928704 00000100:00100000:3.0:1787384496.326147:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173928704 00000100:00100000:3.0:1787384496.326254:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 176 00000100:00100000:3.0:1787384496.326267:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+59:11490:x1874208173928704:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787384496.326367:0:7691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384496.326408:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3f6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fa5 expref: 59 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326432:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4600) 00010000:00010000:3.0:1787384496.326447:0:7691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384496.326480:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3f7a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326498:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3f7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326640:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3f7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326665:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3f81 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xb9276d7b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326690:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9276d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326698:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9276d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326809:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3f7a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326817:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3f7a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326826:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3f7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326833:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fdc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384496.326839:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3f7a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.326848:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3f7a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.327032:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:3.0:1787384496.327037:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384496.327042:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3f7a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.327049:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c3f7a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.327064:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3f81 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9276d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.327077:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3f81 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9276d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.327084:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3f81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9276d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.327088:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384496.327091:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3f81 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9276d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.327098:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3f81 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xb9276d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.327107:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xb9276d7b (ffff89e34836a000) 00010000:00010000:3.0:1787384496.327110:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384496.327112:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3f81 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb9276d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.327118:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3f81 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xb9276d7b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.327246:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+58:11490:x1874208173928704:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 980us (3029us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384496.327257:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 176 00000100:00100000:1.0:1787384496.331772:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384496.331901:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173928832 00000100:00100000:0.0:1787384496.331915:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173928832 00000100:00100000:0.0:1787384496.332009:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 177 00000100:00100000:0.0:1787384496.332021:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+58:11490:x1874208173928832:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384496.332047:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384496.332077:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3f88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78fac expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.332120:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.332136:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.332150:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.332290:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c3f88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fac expref: 60 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.332313:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fac expref: 59 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.332322:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4b00) 00010000:00010000:0.0:1787384496.332327:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384496.332332:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a400, rc 0) 00000100:00100000:0.0:1787384496.332424:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+59:11490:x1874208173928832:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 405us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384496.332433:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 177 00000100:00100000:1.0:1787384496.345906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384496.346166:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173929088 00000100:00100000:2.0:1787384496.346179:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173929088 00000100:00100000:2.0:1787384496.346258:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 178 00000100:00100000:2.0:1787384496.346271:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+59:11490:x1874208173929088:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787384496.346387:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.346407:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.346422:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384496.352205:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1787384496.352228:0:5784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 357495367382ns, next at 358495363560ns, rc = 0 00000004:00010000:2.0:1787384496.356557:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000096b6284f reply state 00000000cc6a9142 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384496.356593:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384496.356776:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+61:11490:x1874208173929088:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 10501us (10881us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1787384496.356787:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 178 00000100:00100000:1.0:1787384496.367050:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384496.367354:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173929216 00000100:00100000:0.0:1787384496.367371:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173929216 00000100:00100000:0.0:1787384496.367452:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 179 00000100:00100000:0.0:1787384496.367468:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+61:11490:x1874208173929216:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384496.367502:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384496.367530:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3f9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78fb3 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.367608:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3f9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fb3 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.367626:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3f9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fb3 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.367651:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4b00) 00010000:00010000:0.0:1787384496.367655:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787384496.367660:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b000, rc 0) 00000100:00100000:0.0:1787384496.367737:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+62:11490:x1874208173929216:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 273us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384496.367744:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 179 00010000:00010000:2.0:1787384496.368210:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.368224:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.368239:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.368249:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384496.368255:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.368267:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.368285:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4b00) 00010000:00010000:2.0:1787384496.368289:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787384496.368296:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.368302:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c3f96 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384496.388527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384496.388610:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173929344 00000100:00100000:2.0:1787384496.388626:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173929344 00000100:00100000:2.0:1787384496.388751:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:2.0:1787384496.388766:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+6:2353:x1874208173929344:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1787384496.389118:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384496.389627:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173929344:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 858us (1121us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1787384496.389639:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:1.0:1787384496.400489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384496.402141:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173929600 00000100:00100000:3.0:1787384496.402164:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173929600 00000100:00100000:3.0:1787384496.402270:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:3.0:1787384496.402282:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+61:11490:x1874208173929600:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787384496.402658:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+62:11490:x1874208173929600:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 376us (2182us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1787384496.402666:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:2.0:1787384496.415485:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384496.415578:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173929856 00000100:00100000:3.0:1787384496.415592:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173929856 00000100:00100000:3.0:1787384496.415669:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 180 00000100:00100000:3.0:1787384496.415681:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+62:11490:x1874208173929856:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1787384496.415842:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+62:11490:x1874208173929856:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 163us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384496.415851:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 180 00000100:00100000:2.0:1787384496.430103:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384496.430652:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173929984 00000100:00100000:0.0:1787384496.430667:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173929984 00000100:00100000:0.0:1787384496.430737:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 181 00000100:00100000:0.0:1787384496.430748:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+62:11490:x1874208173929984:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384496.430776:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384496.430806:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3fa4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78fba expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.430965:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3fab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.430994:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.431008:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384496.431058:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384496.431084:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.431117:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c3fa4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fba expref: 64 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.431140:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3fab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fba expref: 63 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.431151:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4b00) 00010000:00010000:0.0:1787384496.431154:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787384496.431159:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b400, rc 0) 00000100:00100000:0.0:1787384496.431248:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+63:11490:x1874208173929984:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 501us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384496.431257:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 181 00000100:00100000:2.0:1787384496.435511:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384496.435594:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173930112 00000100:00100000:3.0:1787384496.435608:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173930112 00000100:00100000:3.0:1787384496.435678:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:3.0:1787384496.435691:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173930112:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384496.435711:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384496.435745:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3fb2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78fc1 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384496.435784:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8952af, blocks: 0x1 00010000:00010000:3.0:1787384496.435803:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=357s v=(0 0) 00010000:00010000:3.0:1787384496.435808:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384496.435818:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3fb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc1 expref: 8 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.435838:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3fb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc1 expref: 8 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.435899:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd600, rc 0) 00000100:00100000:3.0:1787384496.436031:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173930112:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 343us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384496.436038:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:3.0:1787384496.448071:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384496.451894:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173930368 00000100:00100000:2.0:1787384496.451914:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173930368 00000100:00100000:2.0:1787384496.452435:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 182 00000100:00100000:2.0:1787384496.452446:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+63:11490:x1874208173930368:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787384496.456353:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+63:11490:x1874208173930368:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 3891us (8274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.456379:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 182 00000100:00100000:0.0:1787384496.466175:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384496.466524:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173930496 00000100:00100000:3.0:1787384496.466538:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173930496 00000100:00100000:3.0:1787384496.466605:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:3.0:1787384496.466617:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:11490:x1874208173930496:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384496.466635:0:6575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384496.466652:0:6575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78fc8 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.466681:0:6575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3fb2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc1 expref: 9 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.466691:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384496.466695:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384496.466703:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 9 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.466812:0:6575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3fb2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc1 expref: 9 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.466846:0:6575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3fb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc1 expref: 9 pid: 6574 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.466890:0:6575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3731e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6575:1874208195946880:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384496.467001:0:6575:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4180 going to sleep for 11 seconds 00000100:00100000:3.0:1787384496.480711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384496.480752:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173930624 00000100:00100000:3.0:1787384496.480774:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173930624 00010000:00010000:3.0:1787384496.480829:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3fb2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc1 expref: 10 pid: 6574 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.480935:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:3.0:1787384496.480947:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+10:2352:x1874208173930624:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384496.480966:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384496.481215:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3fb2 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc1 expref: 10 pid: 6574 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.481243:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3fb2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc1 expref: 10 pid: 6574 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.481282:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384496.481287:0:5769:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384496.481296:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 10 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.481331:0:5769:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 10 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.481386:0:5769:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 10 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.481403:0:5769:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3731e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5769:1874208195947008:192.168.203.51@tcp:105: 00000100:00100000:3.0:1787384496.481521:0:5769:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1787384496.482420:0:6575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000883f9687/0x3522fbed3b6c3fb2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc1 expref: 10 pid: 6574 timeout: 457 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384496.482443:0:6575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3731e5500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6575:1874208195946880:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384496.482476:0:6575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 9 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.482491:0:6575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fdc00, rc 0) 00000100:00100000:1.0:1787384496.482604:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+9:11490:x1874208173930496:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 15988us (16444us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.482614:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:0.0:1787384496.492154:0:5769:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3731e7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5769:1874208195947008:192.168.203.51@tcp:105: 00010000:00010000:0.0:1787384496.492190:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384496.492278:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173930624:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 11332us (11578us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384496.492292:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:3.0:1787384496.503190:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384496.510918:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173930752 00000100:00100000:0.0:1787384496.510936:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173930752 00002000:00100000:3.0:1787384496.511357:0:6579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff89e3731e7100 x1874208173930752/t0(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:527/0 lens 504/0 e 0 to 0 dl 1787384507 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384496.511373:0:6579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e3731e7100 with x1874208173930752 ext(0->8) 00002000:00010000:3.0:1787384496.511381:0:6579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e3731e7100 00000100:00100000:3.0:1787384496.511703:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:3.0:1787384496.511716:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173930752:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787384496.512373:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddc9253f-47aa-4509-981d-645f91ec7250+10:2353:x1874208173930752:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 Request processed in 653us (9191us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1787384496.512384:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00002000:00100000:3.0:1787384496.512393:0:6579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff89e3731e7100 x1874208173930752/t4294967314(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:527/0 lens 504/448 e 0 to 0 dl 1787384507 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384496.512402:0:6579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e3731e7100 with x1874208173930752 ext(0->8) 00002000:00010000:3.0:1787384496.512408:0:6579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e3731e7100 00000100:00100000:3.0:1787384496.526146:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384496.526313:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173930880 00000100:00100000:2.0:1787384496.526327:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173930880 00000100:00100000:2.0:1787384496.526401:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 183 00000100:00100000:2.0:1787384496.526413:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+63:11490:x1874208173930880:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1787384496.594415:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+63:11490:x1874208173930880:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 67982us (68262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.594434:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 183 00000001:00080000:1.0:1787384496.594486:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967459 is committed 00000001:00080000:1.0:1787384496.595376:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1787384496.595386:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:1.0:1787384496.595430:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787384496.595449:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e345a2c900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787384496.595454:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e37b298b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e345a2c6c0 00000020:00080000:1.0:1787384496.595457:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e37b298500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e3732e6400 00000020:00080000:0.0:1787384496.595498:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000100:00100000:3.0:1787384496.595909:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384496.595940:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195947136:0@lo:2:osp-syn-1-0.0 00000020:00080000:0.0:1787384496.596091:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1787384496.596110:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384496.596204:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195947136 00000100:00100000:0.0:1787384496.596213:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195947136 00000100:00100000:0.0:1787384496.596274:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787384496.596284:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195947136:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787384496.596453:0:6574:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787384496.596457:0:6574:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787384495 00002000:00010000:0.0:1787384496.596459:0:6574:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787384496.596462:0:6574:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787384495 -> 1787384495 00002000:00010000:0.0:1787384496.596464:0:6574:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787384496.596517:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195947136:12345-0@lo:2:osp-syn-1-0.0 Request processed in 234us (406us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787384496.596526:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:3.0:1787384496.596542:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e37c4ec700/2, rc 0, transno 4294967315 00000100:00100000:3.0:1787384496.596548:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195947136:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1787384496.596718:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:1.0:1787384496.596728:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000100:00100000:1.0:1787384496.597008:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195947264:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787384496.597045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384496.597376:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195947264 00000100:00100000:0.0:1787384496.597382:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195947264 00000100:00100000:0.0:1787384496.597428:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787384496.597437:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195947264:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787384496.597462:0:6576:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:0.0:1787384496.597502:0:6576:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a8952ac, atime: 0x6a8952ad, ctime: 0x6a8952ac, blocks: 0x1 00010000:00010000:0.0:1787384496.597511:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3fc0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.597542:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=357s v=(0 0) 00010000:00010000:0.0:1787384496.597547:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384496.597554:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3fc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.597730:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3fc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.597743:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3fc0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.597752:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3fc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.597879:0:6576:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787384496.598560:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3304:x1874208195947264:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1120us (1510us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1787384496.598582:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:0.0:1787384496.598891:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e37c5afb80/2, rc 0, transno 4294967307 00000100:00100000:0.0:1787384496.598900:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195947264:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787384496.598988:0:8293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384496.598999:0:8293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3fc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.599011:0:8293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384496.599017:0:8293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3fc0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.599028:0:8293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3fc0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.599062:0:8293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3fc0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.599070:0:8293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046d3f5a0/0x3522fbed3b6c3fc0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.599076:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:1.0:1787384496.599096:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384496.599098:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384496.599099:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384496.599255:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173931008 00000100:00100000:0.0:1787384496.599261:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173931008 00000100:00100000:0.0:1787384496.599312:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:0.0:1787384496.599321:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+10:2353:x1874208173931008:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1787384496.689791:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1787384496.689813:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1787384496.689820:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1787384496.695717:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173931008:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 96380us (96628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384496.695754:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:3.0:1787384496.706441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384496.711907:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173931264 00000100:00100000:0.0:1787384496.711932:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173931264 00000100:00100000:0.0:1787384496.712030:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 184 00000100:00100000:0.0:1787384496.712042:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+18:11490:x1874208173931264:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384496.712119:0:7691:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384496.712156:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c3fab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fba expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.712181:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4b00) 00010000:00010000:0.0:1787384496.712187:0:7691:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384496.712239:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.712255:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.712265:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384496.712641:0:7691:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000056407461 reply state 00000000b9cc0558 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384496.712652:0:7691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384496.714060:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+19:11490:x1874208173931264:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 2006us (7620us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1787384496.714074:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 184 00000100:00100000:0.0:1787384496.717482:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195947392:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384496.717609:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384496.718338:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195947392 00000100:00100000:3.0:1787384496.718351:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195947392 00000100:00100000:3.0:1787384496.718417:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787384496.718429:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195947392:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384496.718460:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1787384496.718530:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195947392:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384496.718538:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787384496.718733:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384496.718766:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173931392 00000100:00100000:1.0:1787384496.718770:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173931392 00000100:00100000:1.0:1787384496.718801:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:1.0:1787384496.718808:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173931392:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787384496.719164:0:6575:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787384496.719169:0:6575:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787384495 -> 1787384494 00002000:00010000:1.0:1787384496.719172:0:6575:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787384493 00002000:00010000:1.0:1787384496.719174:0:6575:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787384495 -> 1787384494 00002000:00010000:1.0:1787384496.719176:0:6575:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787384496.719240:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173931392:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 421us (500us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787384496.719248:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:2.0:1787384496.719676:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787384496.719684:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e37c4ec700, transno 4294967315 00000100:00100000:2.0:1787384496.719712:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195947392:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384496.720855:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.720918:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.720928:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.720935:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108bc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384496.720955:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.720964:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.720987:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4b00) 00010000:00010000:3.0:1787384496.720991:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384496.720997:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.721004:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c3fc7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384496.728527:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384496.728615:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173931648 00000100:00100000:3.0:1787384496.728628:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173931648 00000100:00100000:3.0:1787384496.728699:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 185 00000100:00100000:3.0:1787384496.728710:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+18:11490:x1874208173931648:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1787384496.728802:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.728823:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fac expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.728833:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.728910:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fac expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.728928:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fac expref: 18 pid: 5783 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.728972:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195947520:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384496.729086:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3469bb780 going to sleep for 11 seconds 00000100:00100000:2.0:1787384496.742167:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4ec380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195947520:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384496.742208:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384496.743608:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384496.743720:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173931776 00000100:00100000:2.0:1787384496.743733:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173931776 00010000:00010000:2.0:1787384496.743789:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fac expref: 19 pid: 5783 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384496.743839:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:2.0:1787384496.743851:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+19:2352:x1874208173931776:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384496.743898:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384496.743907:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fac expref: 19 pid: 5783 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.743923:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fac expref: 19 pid: 5783 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.743953:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c3f8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fac expref: 19 pid: 5783 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.743974:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4b00) 00010000:00010000:2.0:1787384496.743980:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.743991:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.744000:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.744036:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384496.744127:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441da050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+18:2352:x1874208173931776:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 276us (528us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384496.744135:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 68 00010000:00010000:3.0:1787384496.744263:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.744272:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.744319:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.744327:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.744333:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.744339:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fce00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384496.744345:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.744352:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.744362:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4b00) 00010000:00010000:3.0:1787384496.744365:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1787384496.744369:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.744375:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3fce lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.744429:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+17:11490:x1874208173931648:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 Request processed in 15722us (15927us total) trans 0 rc -22/-22 00000100:00100000:3.0:1787384496.744438:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 185 00000100:00100000:3.0:1787384496.747591:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384496.747743:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173931904 00000100:00100000:1.0:1787384496.747768:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173931904 00000100:00100000:1.0:1787384496.747844:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:1.0:1787384496.747856:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173931904:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1787384496.747980:0:10631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.748006:0:10631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 8 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.748016:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384496.748021:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384496.748026:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.748074:0:10631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 8 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.748090:0:10631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 8 pid: 6575 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384496.748107:0:10631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10631:1874208195947648:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384496.748203:0:10631:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344f480c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384496.757208:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384496.759619:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173932032 00000100:00100000:3.0:1787384496.759639:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173932032 00010000:00010000:3.0:1787384496.759698:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 9 pid: 6575 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.759822:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:3.0:1787384496.759834:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:2352:x1874208173932032:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384496.759911:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384496.759943:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 9 pid: 6575 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.759962:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 9 pid: 6575 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.760004:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384496.760010:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384496.760016:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.760031:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.760089:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384496.760174:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:2352:x1874208173932032:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 339us (2984us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384496.760185:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00010000:00010000:0.0:1787384496.760397:0:10631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000026099e3c/0x3522fbed3b6c3fb9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fc8 expref: 8 pid: 6575 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384496.760419:0:10631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4ed80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10631:1874208195947648:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384496.760443:0:10631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.760458:0:10631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.760468:0:10631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.760505:0:10631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.760514:0:10631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.760523:0:10631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.760531:0:10631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384496.760545:0:10631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.760561:0:10631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.760577:0:10631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.760586:0:10631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000019f1775a/0x3522fbed3b6c3fd5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384496.760642:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173931904:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 12788us (13067us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384496.760652:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:3.0:1787384496.772450:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384496.772704:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173932288 00000100:00100000:0.0:1787384496.772714:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173932288 00000100:00100000:0.0:1787384496.772785:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 186 00000100:00100000:0.0:1787384496.772795:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+17:11490:x1874208173932288:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787384496.772906:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3fdc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.772924:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.772937:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.773194:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.773206:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3f9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fb3 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.773215:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.773257:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3f9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fb3 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.773271:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3f9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fb3 expref: 18 pid: 5783 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384496.773286:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377f55880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195947776:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384496.773364:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bcb6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384496.782514:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384496.782761:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377f55880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195947776:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384496.782795:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.787787:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173932416 00000100:00100000:3.0:1787384496.787809:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173932416 00010000:00010000:3.0:1787384496.787884:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3f9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fb3 expref: 19 pid: 5783 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.787924:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:3.0:1787384496.787935:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+19:2353:x1874208173932416:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384496.787954:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384496.787961:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3f9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fb3 expref: 19 pid: 5783 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.787976:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3f9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fb3 expref: 19 pid: 5783 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.788005:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c3f9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fb3 expref: 19 pid: 5783 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.788025:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4b00) 00010000:00010000:3.0:1787384496.788032:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.788054:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.788063:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.788103:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384496.788178:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+18:2353:x1874208173932416:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 244us (5675us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384496.788186:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 70 00010000:00010000:0.0:1787384496.788440:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.788449:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384496.788716:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:0.0:1787384496.788933:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:0.0:1787384496.788983:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:0.0:1787384496.789082:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377f57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5784:1874208195947904:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787384496.789153:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384496.789202:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c294b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384496.789299:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195947904 00000100:00100000:3.0:1787384496.789316:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195947904 00000100:00100000:3.0:1787384496.789386:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787384496.789397:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5784:x1874208195947904:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787384496.789522:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5784:x1874208195947904:12345-0@lo:1000:mdt00_001.0 Request processed in 126us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384496.789531:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384496.790147:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377f57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5784:1874208195947904:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787384496.790879:0:5784:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:0.0:1787384496.790975:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377f57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5784:1874208195948032:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787384496.791046:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384496.791077:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384496.793635:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195948032 00000100:00100000:3.0:1787384496.793650:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195948032 00000100:00100000:3.0:1787384496.793703:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384496.793712:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5784:x1874208195948032:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1787384496.794041:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5784:x1874208195948032:12345-0@lo:1000:mdt00_001.0 Request processed in 327us (2993us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1787384496.794050:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384496.796417:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377f57b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5784:1874208195948032:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787384496.796491:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796505:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796513:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796520:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ac00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384496.796526:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796536:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796557:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e343ce4b00) 00010000:00010000:2.0:1787384496.796560:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384496.796565:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796571:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c3fe3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796615:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3f18 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796650:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3f18 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796656:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3f18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796661:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624ca00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384496.796665:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3f18 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796670:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3f18 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796680:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919800) 00010000:00010000:2.0:1787384496.796682:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384496.796685:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3f18 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796690:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c3f18 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796719:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796735:0:5784:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f97 expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796744:0:5784:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796802:0:5784:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f97 expref: 21 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384496.796827:0:5784:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f97 expref: 21 pid: 5785 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384496.796845:0:5784:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195948160:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384496.796990:0:5784:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3779cdc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384496.808758:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384496.808927:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173932544 00000100:00100000:1.0:1787384496.808940:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173932544 00010000:00010000:1.0:1787384496.809017:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f97 expref: 22 pid: 5785 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384496.809076:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:1.0:1787384496.809088:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+22:2353:x1874208173932544:12345-192.168.203.51@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1787384496.809101:0:5784:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bd180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5784:1874208195948160:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384496.809107:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384496.809118:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f97 expref: 22 pid: 5785 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.809131:0:5784:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.809135:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f97 expref: 22 pid: 5785 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.809184:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c3f34 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78f97 expref: 22 pid: 5785 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.812587:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919800) 00010000:00010000:1.0:1787384496.812610:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.812629:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.812638:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.812699:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384496.812878:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+21:2353:x1874208173932544:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 3772us (4114us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384496.812891:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 71 00010000:00010000:3.0:1787384496.813248:0:5784:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813318:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813336:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813342:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813348:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813355:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3e00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384496.813360:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813368:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813384:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919800) 00010000:00010000:3.0:1787384496.813388:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384496.813392:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813398:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c3fea lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813417:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3fdc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813433:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3fdc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813439:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3fdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813445:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384496.813449:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3fdc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.813456:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3fdc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.815945:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919800) 00010000:00010000:3.0:1787384496.815961:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787384496.815975:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3fdc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.815987:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c3fdc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384496.818491:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+20:11490:x1874208173932288:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 45617us (45976us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1787384496.818513:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 186 00000020:00080000:3.0:1787384496.818539:0:5784:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787384496.820308:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384496.820321:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384496.824095:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787384496.824119:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384496.828990:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384496.829312:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173932800 00000100:00100000:3.0:1787384496.829326:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173932800 00000100:00100000:3.0:1787384496.829399:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:3.0:1787384496.829412:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350f76c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+20:11490:x1874208173932800:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1787384496.830522:0:5787:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1787384496.830645:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:3.0:1787384496.830713:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.830734:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.830748:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.831010:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.831020:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.831028:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384496.831182:0:5787:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787384496.831355:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350f76c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+22:11490:x1874208173932800:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 1941us (2375us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787384496.831367:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000020:00080000:3.0:1787384496.831375:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787384496.831831:0:8292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384496.831841:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.831850:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384496.831855:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.832002:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.832023:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff89e34836a200) 00010000:00010000:0.0:1787384496.832026:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787384496.832032:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384496.832039:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c3ff1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384496.834154:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384496.834167:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384496.834170:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384497.040944:0:12365:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787384497.040957:0:12365:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384497.041008:0:12365:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787384497.041014:0:12365:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787384497.163120:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384497.182918:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384497.183039:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173933056 00000100:00100000:3.0:1787384497.183052:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173933056 00000100:00100000:3.0:1787384497.183162:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 187 00000100:00100000:3.0:1787384497.183175:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+22:11500:x1874208173933056:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384497.183208:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384497.183247:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3ff8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78fcf expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.183644:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3fff lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.183665:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.183680:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3fff lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384497.183695:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787384497.183953:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c3ff8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fcf expref: 25 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.183977:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3fff lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fcf expref: 24 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.183987:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:3.0:1787384497.183991:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787384497.183995:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd200, rc 0) 00000100:00100000:3.0:1787384497.184082:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+24:11500:x1874208173933056:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 909us (1177us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787384497.184091:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 187 00000100:00080000:2.0:1787384497.184434:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384497.187388:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384497.187570:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173933184 00000100:00100000:1.0:1787384497.187583:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173933184 00000100:00100000:1.0:1787384497.187661:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 188 00000100:00100000:1.0:1787384497.187673:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+24:11500:x1874208173933184:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:1.0:1787384497.187783:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c400d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.187807:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c400d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.187825:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c400d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.187846:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.187853:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.187883:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188268:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188277:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188284:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787384497.188732:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188746:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c400d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188753:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c400d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188760:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c400d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188766:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624da00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384497.188771:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c400d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188778:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c400d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188794:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:1.0:1787384497.188797:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384497.188802:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c400d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188808:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c400d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188822:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188828:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188846:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188851:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384497.188854:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188904:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188913:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e346919500) 00010000:00010000:1.0:1787384497.188916:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384497.188919:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188925:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188944:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188950:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188956:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188961:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624dc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384497.188963:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188979:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188987:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919100) 00010000:00010000:1.0:1787384497.188989:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384497.188992:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.188997:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c401b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384497.189114:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+24:11500:x1874208173933184:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 1439us (1736us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384497.189125:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 188 00000100:00100000:3.0:1787384497.251490:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384497.252329:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173933440 00000100:00100000:1.0:1787384497.252349:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173933440 00000100:00100000:1.0:1787384497.252442:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 189 00000100:00100000:1.0:1787384497.252454:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+24:11503:x1874208173933440:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384497.252484:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384497.252510:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c4022 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78fd6 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.252607:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4029 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.252626:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.252640:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.252674:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c4030 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.252682:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c4030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.252690:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c4030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253127:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253137:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253145:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384497.253157:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787384497.253291:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4029 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253301:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4029 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253308:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253315:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384497.253321:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4029 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253340:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4029 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253356:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:1.0:1787384497.253359:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384497.253366:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4029 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253372:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4029 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253387:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c4030 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253393:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c4030 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253399:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c4030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253405:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624da00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384497.253408:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c4030 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253414:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c4030 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253421:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e346919100) 00010000:00010000:1.0:1787384497.253424:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384497.253426:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c4030 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253442:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c4030 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253497:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624dc00/0x3522fbed3b6c4022 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fd6 expref: 27 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253511:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fd6 expref: 26 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.253518:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:1.0:1787384497.253521:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384497.253523:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d600, rc 0) 00000100:00100000:1.0:1787384497.253619:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+26:11503:x1874208173933440:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1167us (2151us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1787384497.253628:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 189 00000100:00100000:0.0:1787384497.264454:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384497.264505:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173933568 00000100:00100000:0.0:1787384497.264519:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173933568 00000100:00100000:0.0:1787384497.264587:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 190 00000100:00100000:0.0:1787384497.264599:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+26:11503:x1874208173933568:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:0.0:1787384497.265153:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.265173:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.265188:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.265238:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.265247:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4045 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.265255:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.265261:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384497.265267:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.265276:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.265289:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:0.0:1787384497.265293:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384497.265452:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4045 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.265462:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384497.265563:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+26:11503:x1874208173933568:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 963us (1126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384497.265574:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 190 00000100:00100000:0.0:1787384497.269088:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384497.269710:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173933824 00000100:00100000:3.0:1787384497.269727:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173933824 00000100:00100000:3.0:1787384497.269821:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:3.0:1787384497.269832:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+26:11503:x1874208173933824:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1787384497.270579:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+27:11503:x1874208173933824:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 743us (1498us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1787384497.270590:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:0.0:1787384497.317491:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384497.317752:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173934080 00000100:00100000:3.0:1787384497.317768:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173934080 00000100:00100000:3.0:1787384497.317848:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 191 00000100:00100000:3.0:1787384497.317884:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+27:11037:x1874208173934080:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1787384497.317920:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384497.318099:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c404c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78fdd expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.318270:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.318291:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fd6 expref: 28 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.318302:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.318366:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fd6 expref: 28 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.318385:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fd6 expref: 28 pid: 5783 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384497.318428:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195948288:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384497.318565:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3661c4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384497.322663:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384497.322791:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4eca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195948288:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384497.322828:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384497.325617:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173934208 00000100:00100000:0.0:1787384497.325640:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173934208 00010000:00010000:3.0:1787384497.325730:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fd6 expref: 29 pid: 5783 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384497.325789:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:3.0:1787384497.325801:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+29:2352:x1874208173934208:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384497.325822:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384497.325830:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fd6 expref: 29 pid: 5783 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.325846:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fd6 expref: 29 pid: 5783 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.325894:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c4037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fd6 expref: 29 pid: 5783 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.325911:0:5770:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:3.0:1787384497.325917:0:5770:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.325940:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.325949:0:5770:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.325981:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384497.326258:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+28:2352:x1874208173934208:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 262us (3412us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384497.326268:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 72 00010000:00010000:3.0:1787384497.326678:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.326689:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384497.326718:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787384497.326959:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c404c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fdd expref: 29 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.326980:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fdd expref: 28 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.326988:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:3.0:1787384497.326991:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787384497.326994:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fd400, rc 0) 00000100:00100000:3.0:1787384497.327042:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+28:11037:x1874208173934080:12345-192.168.203.51@tcp:101:bash.0 Request processed in 9184us (9567us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1787384497.327065:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 191 00000100:00100000:2.0:1787384497.335453:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384497.336213:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173934464 00000100:00100000:0.0:1787384497.336236:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173934464 00000100:00100000:0.0:1787384497.336667:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 192 00000100:00100000:0.0:1787384497.336682:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+28:11037:x1874208173934464:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:2.0:1787384497.339480:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.339515:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.339529:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384497.339643:0:7691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:2.0:1787384497.339683:0:7691:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000899aaad5 reply state 000000005e7726d0 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384497.339694:0:7691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1787384497.339759:0:7691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:2.0:1787384497.339960:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+32:11037:x1874208173934464:12345-192.168.203.51@tcp:36:bash.0 Request processed in 3263us (4506us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787384497.339971:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 192 00000020:00080000:2.0:1787384497.339995:0:7691:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:0.0:1787384497.344271:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:2.0:1787384497.345322:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.345347:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.345358:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.345364:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384497.345371:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.345381:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.345407:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:2.0:1787384497.345411:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384497.345416:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.345423:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4061 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384497.345747:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173934592 00000100:00100000:1.0:1787384497.345760:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173934592 00000100:00100000:1.0:1787384497.345837:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 193 00000100:00100000:1.0:1787384497.345849:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+31:11037:x1874208173934592:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:1.0:1787384497.345922:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384497.345944:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78fe4 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.346020:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fe4 expref: 32 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.346035:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fe4 expref: 32 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.346150:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:1.0:1787384497.346153:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384497.346156:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d400, rc 0) 00000100:00100000:1.0:1787384497.346247:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+32:11037:x1874208173934592:12345-192.168.203.51@tcp:101:bash.0 Request processed in 400us (1992us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384497.346255:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 193 00000100:00100000:1.0:1787384497.351207:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384497.351582:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173934720 00000100:00100000:2.0:1787384497.351603:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173934720 00000100:00100000:2.0:1787384497.351687:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:2.0:1787384497.351700:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:11037:x1874208173934720:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384497.351724:0:6575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384497.351754:0:6575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c406f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78feb expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384497.351819:0:6575:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8952ae, atime: 0x6a8952ad, ctime: 0x6a8952ae, blocks: 0xb 00010000:00010000:2.0:1787384497.351850:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=358s v=(0 0) 00010000:00010000:2.0:1787384497.351855:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384497.351888:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c406f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78feb expref: 8 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.351908:0:6575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c406f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78feb expref: 8 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.351925:0:6575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3c00, rc 0) 00000100:00100000:2.0:1787384497.352020:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:11037:x1874208173934720:12345-192.168.203.51@tcp:101:bash.0 Request processed in 322us (2717us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384497.352028:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:2.0:1787384497.361776:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384497.362021:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173934848 00000100:00100000:0.0:1787384497.362035:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173934848 00002000:00010000:0.0:1787384497.362097:0:6581:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787384497.362102:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e37c39d500 with x1874208173934848 ext(0->18446744073709551615) 00002000:00010000:0.0:1787384497.362117:0:6581:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e37c39d500. 00000100:00100000:0.0:1787384497.362153:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:0.0:1787384497.362164:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddc9253f-47aa-4509-981d-645f91ec7250+8:2350:x1874208173934848:12345-192.168.203.51@tcp:10:bash.0 00002000:00010000:0.0:1787384497.363721:0:6581:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787384497.363733:0:6581:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787384494 -> 1787384496 00002000:00010000:0.0:1787384497.363736:0:6581:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787384493 -> 1787384493 00002000:00010000:0.0:1787384497.363757:0:6581:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787384494 -> 1787384496 00002000:00010000:0.0:1787384497.363759:0:6581:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787384497.363878:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:2350:x1874208173934848:12345-192.168.203.51@tcp:10:bash.0 Request processed in 1695us (2096us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1787384497.363892:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00002000:00010000:0.0:1787384497.363899:0:6581:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:0.0:1787384497.363902:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e37c39d500 with x1874208173934848 ext(0->18446744073709551615) 00002000:00010000:0.0:1787384497.363910:0:6581:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e37c39d500. 00000100:00100000:3.0:1787384497.487633:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384497.487926:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173934976 00000100:00100000:2.0:1787384497.487950:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173934976 00000100:00100000:2.0:1787384497.488045:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 194 00000100:00100000:2.0:1787384497.488058:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+32:11517:x1874208173934976:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:2.0:1787384497.488175:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c4076 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488199:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c4076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488216:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c4076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488269:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c407d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488278:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c407d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488287:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c407d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488698:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488710:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488717:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384497.488790:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488803:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c4076 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488809:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c4076 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488816:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c4076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488823:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384497.488828:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c4076 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488844:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c4076 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488918:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384497.488922:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384497.488928:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c4076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488935:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c4076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488953:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c407d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488959:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c407d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488966:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c407d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488971:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384497.488974:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c407d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488979:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c407d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.488986:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e345695700) 00010000:00010000:2.0:1787384497.488988:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384497.488991:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c407d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.489008:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c407d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.489035:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.489042:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.489049:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.489054:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384497.489058:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.489064:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.489074:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:2.0:1787384497.489076:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384497.489079:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.489085:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384497.489200:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+32:11517:x1874208173934976:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 1141us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384497.489212:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 194 00000100:00100000:1.0:1787384497.589818:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384497.589923:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173935232 00000100:00100000:3.0:1787384497.589950:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173935232 00000100:00100000:3.0:1787384497.590043:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 195 00000100:00100000:3.0:1787384497.590058:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+32:11520:x1874208173935232:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384497.590095:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384497.590127:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c408b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ff2 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.590247:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c4092 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.590264:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c4092 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.590278:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c4092 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.590295:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c4099 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.590303:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c4099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.590310:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c4099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.590747:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c40a0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591053:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c40a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591063:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c40a0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384497.591077:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787384497.591211:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c4092 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591220:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c4092 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591236:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c4092 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591242:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384497.591248:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c4092 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591256:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c4092 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591271:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:3.0:1787384497.591274:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384497.591280:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c4092 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591286:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd600/0x3522fbed3b6c4092 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591302:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c4099 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591317:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c4099 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591323:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c4099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591328:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fdc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384497.591331:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c4099 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591338:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c4099 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591346:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e34836a500) 00010000:00010000:3.0:1787384497.591348:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384497.591351:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c4099 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591358:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fdc00/0x3522fbed3b6c4099 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591410:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fce00/0x3522fbed3b6c408b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ff2 expref: 35 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591427:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c40a0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ff2 expref: 34 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.591435:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:3.0:1787384497.591438:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787384497.591446:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030400, rc 0) 00000100:00100000:3.0:1787384497.592140:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+34:11520:x1874208173935232:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 2079us (2328us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787384497.592152:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 195 00000100:00100000:0.0:1787384497.601428:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384497.605021:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173935360 00000100:00100000:1.0:1787384497.605044:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173935360 00000100:00100000:1.0:1787384497.605235:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 196 00000100:00100000:1.0:1787384497.605249:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+34:11520:x1874208173935360:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:1.0:1787384497.605350:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.605373:0:7691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fdd expref: 34 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.605384:0:7691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.605433:0:7691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fdd expref: 34 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.605450:0:7691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fdd expref: 34 pid: 5785 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384497.605495:0:7691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195948416:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384497.605638:0:7691:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344f48e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384497.611250:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384497.611396:0:7691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195948416:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384497.611431:0:7691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384497.611507:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173935616 00000100:00100000:3.0:1787384497.611515:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173935616 00000100:00100000:3.0:1787384497.611588:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:3.0:1787384497.611601:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+35:5565:x1874208173935616:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787384497.612350:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+36:5565:x1874208173935616:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 747us (1110us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1787384497.612360:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:3.0:1787384497.623490:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384497.623676:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173935744 00000100:00100000:2.0:1787384497.623692:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173935744 00010000:00010000:2.0:1787384497.623748:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fdd expref: 36 pid: 5785 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384497.623804:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:2.0:1787384497.623815:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+36:2352:x1874208173935744:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384497.623835:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384497.623843:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fdd expref: 36 pid: 5785 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.623897:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fdd expref: 36 pid: 5785 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.623928:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd400/0x3522fbed3b6c4053 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fdd expref: 36 pid: 5785 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.623949:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:2.0:1787384497.623955:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.623967:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.623977:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.624019:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384497.624085:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4edf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+35:2352:x1874208173935744:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 271us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384497.624113:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 73 00010000:00010000:3.0:1787384497.624314:0:7691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.624323:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.624364:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.624373:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.624380:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.624386:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624ce00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384497.624392:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.624413:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.624424:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:3.0:1787384497.624427:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384497.624432:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384497.624439:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384497.624489:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+34:11520:x1874208173935360:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 19243us (23081us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384497.624547:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 196 00000100:00100000:0.0:1787384497.627767:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384497.631783:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173936000 00000100:00100000:3.0:1787384497.631810:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173936000 00000100:00100000:3.0:1787384497.631929:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:3.0:1787384497.631951:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+34:11520:x1874208173936000:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1787384497.632321:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+35:11520:x1874208173936000:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 380us (4578us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787384497.632330:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:0.0:1787384497.797652:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384497.802499:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173936256 00000100:00100000:1.0:1787384497.802527:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173936256 00000100:00100000:1.0:1787384497.802639:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 197 00000100:00100000:1.0:1787384497.802653:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+35:11531:x1874208173936256:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:1.0:1787384497.802694:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384497.802727:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee78ff9 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.802880:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c40bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.802904:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c40bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.802920:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c40bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.802940:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c40c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.803704:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c40c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.803739:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c40c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805520:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c40ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805544:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c40ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805556:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c40ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384497.805570:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1787384497.805704:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c40bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805713:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c40bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805720:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c40bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805727:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624cc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384497.805732:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c40bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805741:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c40bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805755:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:1.0:1787384497.805759:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384497.805772:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c40bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805778:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c40bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805794:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c40c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805801:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c40c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805806:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c40c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805811:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624da00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384497.805815:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c40c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805821:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c40c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805829:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e346919100) 00010000:00010000:1.0:1787384497.805832:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384497.805835:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c40c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805841:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c40c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.805983:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c40b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ff9 expref: 38 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.806014:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c40ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ff9 expref: 37 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.806023:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:1.0:1787384497.806025:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384497.806028:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d600, rc 0) 00000100:00100000:1.0:1787384497.806132:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373138380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+37:11531:x1874208173936256:12345-192.168.203.51@tcp:101:cat.0 Request processed in 3480us (8496us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787384497.806143:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 197 00000100:00100000:3.0:1787384497.812346:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384497.812664:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173936512 00000100:00100000:0.0:1787384497.812679:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173936512 00000100:00100000:0.0:1787384497.812754:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:0.0:1787384497.812765:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+37:11531:x1874208173936512:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:0.0:1787384497.813194:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+38:11531:x1874208173936512:12345-192.168.203.51@tcp:35:cat.0 Request processed in 428us (863us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787384497.813204:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 54 00000100:00100000:2.0:1787384497.878636:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384497.878745:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173936768 00000100:00100000:0.0:1787384497.878759:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173936768 00000100:00100000:0.0:1787384497.878842:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 198 00000100:00100000:0.0:1787384497.878852:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+38:11533:x1874208173936768:12345-192.168.203.51@tcp:36:rm.0 00010000:00010000:0.0:1787384497.878975:0:5784:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787384497.879016:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d600/0x3522fbed3b6c40ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ff9 expref: 38 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879068:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c40a0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ff2 expref: 37 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879083:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d400/0x3522fbed3b6c4068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fe4 expref: 36 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879094:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e346919500) 00010000:00010000:0.0:1787384497.879107:0:5784:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384497.879136:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c40d8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879151:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c40d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879162:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c40d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879179:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879186:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879193:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879606:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c40e6 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879617:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c40e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.879631:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c40e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384497.880425:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787384497.880439:0:5784:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 359023578295ns, next at 360023575442ns, rc = 0 00010000:00010000:0.0:1787384497.880513:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880527:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880537:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880546:0:5784:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880553:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880560:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880583:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384497.880608:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c40e6 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880615:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c40e6 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880622:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c40e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880635:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384497.880640:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c40e6 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880649:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c40e6 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880663:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e357751400) 00010000:00010000:0.0:1787384497.880666:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787384497.880671:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c40e6 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880678:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c40e6 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880700:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c40d8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880707:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c40d8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880713:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c40d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880718:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ac00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384497.880721:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c40d8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880727:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c40d8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880746:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:0.0:1787384497.880748:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384497.880751:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c40d8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.880758:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c40d8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384497.880769:0:5784:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000a9161d4 reply state 00000000c1401069 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384497.880779:0:5784:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384497.880946:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c39c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+37:11533:x1874208173936768:12345-192.168.203.51@tcp:36:rm.0 Request processed in 2091us (2320us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1787384497.880957:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 198 00010000:00010000:1.0:1787384497.881306:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384497.881315:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.881322:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384497.881326:0:5771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.881333:0:5771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.881345:0:5771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff89e357751400) 00010000:00010000:1.0:1787384497.881347:0:5771:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787384497.881351:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.881357:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c40ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384497.881374:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384497.881384:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384497.881386:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384497.882705:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.882724:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.882732:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.882738:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384497.882743:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.882751:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.882784:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e357751200) 00010000:00010000:0.0:1787384497.882787:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384497.882791:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384497.882796:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c40df lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384497.956622:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384497.964846:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173937024 00000100:00100000:1.0:1787384497.964887:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173937024 00000100:00100000:2.0:1787384497.966059:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 199 00000100:00100000:2.0:1787384497.966074:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+36:11538:x1874208173937024:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384497.966112:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384497.966142:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c40f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79000 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.966341:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c40fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.966360:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c40fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.966374:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c40fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.966392:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.966399:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.966407:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384497.967258:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:2.0:1787384497.967467:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967488:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967497:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967544:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c40fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967553:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c40fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967560:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c40fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967566:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384497.967570:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c40fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967577:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c40fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967591:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384497.967595:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384497.967601:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c40fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967608:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2c00/0x3522fbed3b6c40fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384497.967624:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005add70ab reply state 00000000bb9b70b1 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384497.967641:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787384497.967681:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3200/0x3522fbed3b6c40f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79000 expref: 39 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967697:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79000 expref: 38 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.967705:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695200) 00010000:00010000:2.0:1787384497.967707:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384497.967710:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2200, rc 0) 00000100:00100000:2.0:1787384497.967819:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+39:11538:x1874208173937024:12345-192.168.203.51@tcp:101:bash.0 Request processed in 1748us (11214us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1787384497.967829:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 199 00010000:00010000:2.0:1787384497.971733:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.972144:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.972156:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.972162:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384497.972169:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.972178:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.972404:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e345695700) 00010000:00010000:2.0:1787384497.972409:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384497.972415:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.972422:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3600/0x3522fbed3b6c4102 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384497.982602:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384497.982831:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173937152 00000100:00100000:2.0:1787384497.982848:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173937152 00000100:00100000:2.0:1787384497.982970:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:2.0:1787384497.982982:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173937152:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384497.983007:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384497.983037:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f904d2a2/0x3522fbed3b6c4117 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79007 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384497.983076:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384497.983109:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=359s v=(0 0) 00010000:00010000:2.0:1787384497.983114:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384497.983127:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f904d2a2/0x3522fbed3b6c4117 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79007 expref: 8 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.983152:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f904d2a2/0x3522fbed3b6c4117 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79007 expref: 8 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.983168:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3400, rc 0) 00000100:00100000:2.0:1787384497.983260:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173937152:12345-192.168.203.51@tcp:101:bash.0 Request processed in 281us (6327us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384497.983289:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00080000:3.0:1787384497.984129:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384497.987047:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384497.989017:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173937280 00000100:00100000:2.0:1787384497.989038:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173937280 00000100:00100000:2.0:1787384497.989117:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:2.0:1787384497.989129:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:11538:x1874208173937280:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384497.989155:0:6575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384497.989180:0:6575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7900e expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.989233:0:6575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f904d2a2/0x3522fbed3b6c4117 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79007 expref: 9 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.989245:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384497.989250:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384497.989257:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 9 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.990196:0:6575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f904d2a2/0x3522fbed3b6c4117 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79007 expref: 9 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384497.990234:0:6575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f904d2a2/0x3522fbed3b6c4117 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79007 expref: 9 pid: 6574 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384497.990253:0:6575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3731e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6575:1874208195948544:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384497.991195:0:6575:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3779cd300 going to sleep for 11 seconds 00000100:00100000:1.0:1787384498.004404:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384498.004753:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173937408 00000100:00100000:0.0:1787384498.004766:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173937408 00010000:00010000:0.0:1787384498.004832:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f904d2a2/0x3522fbed3b6c4117 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79007 expref: 10 pid: 6574 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384498.004911:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:0.0:1787384498.004922:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+10:2352:x1874208173937408:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384498.004949:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384498.004979:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f904d2a2/0x3522fbed3b6c4117 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79007 expref: 10 pid: 6574 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.004995:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f904d2a2/0x3522fbed3b6c4117 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79007 expref: 10 pid: 6574 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.005032:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384498.005037:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384498.005048:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 10 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.005074:0:6575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f904d2a2/0x3522fbed3b6c4117 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79007 expref: 10 pid: 6574 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.005079:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 10 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384498.005102:0:6575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3731e6680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6575:1874208195948544:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384498.005127:0:5770:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 9 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.005133:0:6575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 9 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.005143:0:6575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3600, rc 0) 00000100:00100000:0.0:1787384498.005143:0:5770:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37313bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5770:1874208195948672:192.168.203.51@tcp:105: 00000100:00100000:0.0:1787384498.005239:0:5770:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4180 going to sleep for 11 seconds 00000100:00100000:3.0:1787384498.008416:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+9:11538:x1874208173937280:12345-192.168.203.51@tcp:101:bash.0 Request processed in 16804us (18899us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384498.008449:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:0.0:1787384498.014545:0:5770:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37313bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5770:1874208195948672:192.168.203.51@tcp:105: 00010000:00010000:0.0:1787384498.014583:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384498.014661:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173937408:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 9739us (10270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384498.014674:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:2.0:1787384498.015965:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384498.016057:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173937664 00000100:00100000:0.0:1787384498.016069:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173937664 00000100:00100000:0.0:1787384498.016140:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 55 00000100:00100000:0.0:1787384498.016150:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+38:11538:x1874208173937664:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:0.0:1787384498.016631:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+39:11538:x1874208173937664:12345-192.168.203.51@tcp:35:bash.0 Request processed in 479us (675us total) trans 4294967484 rc 0/0 00000100:00100000:0.0:1787384498.016639:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 55 00010000:00010000:1.0:1787384498.185228:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384498.336252:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384498.336323:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384498.336565:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173937920 00000100:00100000:2.0:1787384498.336579:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173937920 00000100:00100000:2.0:1787384498.336656:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:2.0:1787384498.336667:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2350:x1874208173937920:12345-192.168.203.51@tcp:16:kworker.0 00000100:00100000:2.0:1787384498.336839:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2350:x1874208173937920:12345-192.168.203.51@tcp:16:kworker.0 Request processed in 173us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.336846:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:3.0:1787384498.337058:0:6579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173937792 00000100:00100000:3.0:1787384498.337064:0:6579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173937792 00002000:00100000:3.0:1787384498.337100:0:6579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff89e377b4c380 x1874208173937792/t0(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:529/0 lens 504/0 e 0 to 0 dl 1787384509 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384498.337113:0:6579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e377b4c380 with x1874208173937792 ext(0->8) 00002000:00010000:3.0:1787384498.337120:0:6579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e377b4c380 00000100:00100000:3.0:1787384498.337142:0:6579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:3.0:1787384498.337149:0:6579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2350:x1874208173937792:12345-192.168.203.51@tcp:4:bash.0 00000100:00100000:3.0:1787384498.337635:0:6579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:ddc9253f-47aa-4509-981d-645f91ec7250+10:2350:x1874208173937792:12345-192.168.203.51@tcp:4:bash.0 Request processed in 483us (1309us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787384498.337643:0:6579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00002000:00100000:3.0:1787384498.337650:0:6579:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff89e377b4c380 x1874208173937792/t4294967308(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:529/0 lens 504/448 e 0 to 0 dl 1787384509 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384498.337659:0:6579:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e377b4c380 with x1874208173937792 ext(0->8) 00002000:00010000:3.0:1787384498.337667:0:6579:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff89e377b4c380 00000100:00100000:2.0:1787384498.352519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384498.352793:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173938048 00000100:00100000:0.0:1787384498.352807:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173938048 00000100:00100000:0.0:1787384498.352940:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 200 00000100:00100000:0.0:1787384498.352953:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+39:11555:x1874208173938048:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384498.353001:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384498.353030:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4125 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79015 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.353120:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c412c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.353138:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c412c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.353152:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c412c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384498.353248:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787384498.353252:0:5784:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384498.353281:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c412c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.353310:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4125 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79015 expref: 41 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.353330:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c412c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79015 expref: 40 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.353339:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:0.0:1787384498.353342:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787384498.353347:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b800, rc 0) 00000100:00100000:0.0:1787384498.353435:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+40:11555:x1874208173938048:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 483us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384498.353443:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 200 00000100:00100000:1.0:1787384498.362545:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384498.362767:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173938304 00000100:00100000:2.0:1787384498.362783:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173938304 00000100:00100000:2.0:1787384498.362905:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 201 00000100:00100000:2.0:1787384498.362920:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+40:11555:x1874208173938304:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384498.362960:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384498.362990:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4133 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7901c expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.363143:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c413a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.363159:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c413a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.363173:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c413a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384498.363189:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1787384498.363372:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7901c expref: 43 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.363419:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c413a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7901c expref: 42 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.363428:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695200) 00010000:00010000:2.0:1787384498.363432:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384498.363437:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2000, rc 0) 00000100:00100000:2.0:1787384498.363509:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+42:11555:x1874208173938304:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 593us (978us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1787384498.363518:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 201 00000100:00100000:1.0:1787384498.376211:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384498.376923:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173938560 00000100:00100000:0.0:1787384498.376939:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173938560 00000100:00100000:0.0:1787384498.377022:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 202 00000100:00100000:0.0:1787384498.377033:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+42:11555:x1874208173938560:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384498.377071:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384498.377097:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4148 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79023 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.377242:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c414f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.377260:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c414f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.377283:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c414f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384498.377298:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1787384498.377456:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4148 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79023 expref: 45 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.377479:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c414f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79023 expref: 44 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.377488:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695200) 00010000:00010000:0.0:1787384498.377491:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787384498.377495:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108bc00, rc 0) 00000100:00100000:0.0:1787384498.377573:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+44:11555:x1874208173938560:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 541us (1379us total) trans 4294967486 rc 0/0 00000100:00100000:0.0:1787384498.377602:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 202 00000100:00100000:1.0:1787384498.378300:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384498.379074:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173938688 00000100:00100000:2.0:1787384498.379085:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173938688 00000100:00100000:2.0:1787384498.379162:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:2.0:1787384498.379172:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+44:2352:x1874208173938688:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384498.379189:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384498.379230:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c413a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7901c expref: 44 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.379251:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695200) 00010000:00010000:2.0:1787384498.379255:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384498.379319:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441da450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+43:2352:x1874208173938688:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 148us (1024us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.379328:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:1.0:1787384498.392240:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384498.392330:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173938816 00000100:00100000:0.0:1787384498.392343:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173938816 00000100:00100000:0.0:1787384498.392414:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:0.0:1787384498.392425:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+10:2352:x1874208173938816:12345-192.168.203.51@tcp:1:lfs.0 00010000:00010000:0.0:1787384498.392484:0:6576:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.392509:0:6576:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 10 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.392519:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384498.392523:0:6576:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787384498.392528:0:6576:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.392573:0:6576:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 10 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.392589:0:6576:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 10 pid: 6575 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384498.392606:0:6576:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37313bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6576:1874208195948800:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384498.392729:0:6576:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384498.396907:0:6576:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37313bb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6576:1874208195948800:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384498.396949:0:6576:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384498.404146:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384498.404281:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173938944 00000100:00100000:3.0:1787384498.404295:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173938944 00010000:00010000:3.0:1787384498.404351:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 11 pid: 6575 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384498.404404:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 75 00000100:00100000:3.0:1787384498.404415:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+11:2353:x1874208173938944:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384498.404433:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787384498.404458:0:7472:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787384498.404462:0:7472:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787384497 00002000:00010000:3.0:1787384498.404464:0:7472:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787384497 00010000:00010000:3.0:1787384498.404471:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 11 pid: 6575 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.404487:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 11 pid: 6575 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.404521:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038c6dcac/0x3522fbed3b6c411e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7900e expref: 11 pid: 6575 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.404540:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384498.404545:0:7472:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384498.404552:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.404563:0:7472:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.404621:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384498.404693:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+10:2353:x1874208173938944:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 279us (560us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384498.404702:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 75 00010000:00010000:2.0:1787384498.404952:0:6576:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.404963:0:6576:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.404993:0:6576:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.405003:0:6576:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.405011:0:6576:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.405018:0:6576:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ac00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384498.405024:0:6576:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.405033:0:6576:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.405047:0:6576:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.405068:0:6576:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007f90f58f/0x3522fbed3b6c415d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6576 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384498.405138:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:2352:x1874208173938816:12345-192.168.203.51@tcp:1:lfs.0 Request processed in 12714us (12920us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.405147:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:0.0:1787384498.415902:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384498.416088:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173939200 00000100:00100000:3.0:1787384498.416104:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173939200 00000100:00100000:3.0:1787384498.416177:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 56 00000100:00100000:3.0:1787384498.416191:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350f76050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+43:11555:x1874208173939200:12345-192.168.203.51@tcp:35:lfs.0 00000004:00010000:3.0:1787384498.416296:0:5787:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c414f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79023 expref: 43 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384498.416636:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787384498.416684:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:3.0:1787384498.417193:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:3.0:1787384498.417284:0:5787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.417307:0:5787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79000 expref: 47 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.417319:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.417372:0:5787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79000 expref: 47 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.417394:0:5787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79000 expref: 47 pid: 5783 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384498.417431:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4eed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1874208195948928:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384498.417795:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e352f90180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384498.426947:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384498.427161:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4eed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5787:1874208195948928:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384498.427200:0:5787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384498.427295:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173939328 00000100:00100000:2.0:1787384498.427304:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173939328 00010000:00010000:2.0:1787384498.427353:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79000 expref: 48 pid: 5783 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384498.427399:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 76 00000100:00100000:2.0:1787384498.427410:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+48:2352:x1874208173939328:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384498.427430:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384498.427437:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79000 expref: 48 pid: 5783 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.427450:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79000 expref: 48 pid: 5783 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.427481:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79000 expref: 48 pid: 5783 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.427501:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695200) 00010000:00010000:2.0:1787384498.427507:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.427537:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.427546:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.427578:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384498.427648:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+47:2352:x1874208173939328:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 239us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.427657:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 76 00010000:00010000:3.0:1787384498.427952:0:5787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.427961:0:5787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384498.428148:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1787384498.428414:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1787384498.428557:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4eed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195949056:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787384498.428624:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384498.428664:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3469bb780 going to sleep for 11 seconds 00000100:00100000:2.0:1787384498.432142:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195949056 00000100:00100000:2.0:1787384498.432167:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195949056 00000100:00100000:2.0:1787384498.432294:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384498.432308:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5787:x1874208195949056:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787384498.432557:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5787:x1874208195949056:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 252us (3931us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.432565:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787384498.432681:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384498.432788:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4eed80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195949056:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787384498.433517:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1787384498.433647:0:5787:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377963800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195949184:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787384498.433723:0:5787:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384498.433767:0:5787:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e352f90180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384498.438591:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195949184 00000100:00100000:2.0:1787384498.438613:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195949184 00000100:00100000:2.0:1787384498.438690:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384498.438702:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5787:x1874208195949184:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787384498.442669:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377962680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+8:5787:x1874208195949184:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 3955us (8931us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787384498.442691:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384498.448503:0:5787:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377963800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5787:1874208195949184:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1787384498.448652:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1787384498.448743:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.448756:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.448765:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.448791:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384498.448797:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.448806:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.448827:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695200) 00010000:00010000:1.0:1787384498.448830:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1787384498.448836:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.448842:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c4164 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787384498.449202:0:5787:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1787384498.449350:0:5787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1787384498.449366:0:5787:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 359592505286ns, next at 360592502321ns, rc = 0 00000001:00080000:1.0:1787384498.449374:0:5787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1787384498.449419:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695200) 00010000:00010000:1.0:1787384498.449422:0:5787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787384498.449432:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c414f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79023 expref: 51 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384498.450462:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350f76050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+50:11555:x1874208173939200:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 34265us (34610us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1787384498.450480:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 56 00000020:00080000:1.0:1787384498.450490:0:5787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787384498.458442:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384498.458634:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173939456 00000100:00100000:2.0:1787384498.458649:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173939456 00000100:00100000:2.0:1787384498.458733:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 203 00000100:00100000:2.0:1787384498.458763:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+50:11555:x1874208173939456:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384498.458795:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384498.458827:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c416b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7902a expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.458940:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c416b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7902a expref: 51 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.458958:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c416b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7902a expref: 51 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.458981:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:2.0:1787384498.458985:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384498.458990:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2200, rc 0) 00000100:00100000:2.0:1787384498.459066:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377960000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+51:11555:x1874208173939456:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 305us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.459073:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 203 00000100:00100000:3.0:1787384498.462684:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384498.462902:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173939712 00000100:00100000:1.0:1787384498.462916:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173939712 00000100:00100000:3.0:1787384498.463045:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:3.0:1787384498.463065:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+51:11555:x1874208173939712:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1787384498.463510:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+52:11555:x1874208173939712:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 450us (843us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787384498.463520:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 57 00000100:00100000:1.0:1787384498.578499:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384498.578930:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173939840 00000100:00100000:0.0:1787384498.578947:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173939840 00000100:00100000:0.0:1787384498.579035:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 204 00000100:00100000:0.0:1787384498.579048:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+52:11565:x1874208173939840:12345-192.168.203.51@tcp:34:lfs.0 00010000:00010000:0.0:1787384498.579401:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c4172 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579423:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c4172 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579438:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c4172 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579456:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4179 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579464:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579471:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579602:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579611:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579618:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384498.579672:0:5784:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579706:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c4172 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579714:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c4172 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579722:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c4172 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579728:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108bc00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384498.579734:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c4172 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.579742:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c4172 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581101:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:0.0:1787384498.581108:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384498.581116:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c4172 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581126:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c4172 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581150:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4179 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581158:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4179 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581165:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581188:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384498.581193:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4179 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581201:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4179 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581210:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e357751200) 00010000:00010000:0.0:1787384498.581213:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384498.581229:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4179 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581236:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4179 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581258:0:5784:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581265:0:5784:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581271:0:5784:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581276:0:5784:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ac00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384498.581279:0:5784:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581285:0:5784:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581305:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:0.0:1787384498.581307:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384498.581310:0:5784:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.581317:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c4180 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384498.581548:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377962d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+52:11565:x1874208173939840:12345-192.168.203.51@tcp:34:lfs.0 Request processed in 2495us (3056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384498.581561:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 204 00000100:00100000:1.0:1787384498.683392:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384498.683499:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173940096 00000100:00100000:3.0:1787384498.683535:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173940096 00000100:00100000:3.0:1787384498.683622:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 205 00000100:00100000:3.0:1787384498.683635:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+52:11568:x1874208173940096:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384498.683669:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384498.683697:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c4187 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79031 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.683807:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c418e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.683827:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c418e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.683843:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c418e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.683914:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c4195 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.683924:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c4195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684071:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c4195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684333:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684343:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684351:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384498.684374:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787384498.684519:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c418e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684528:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c418e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684534:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c418e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684541:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384498.684546:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c418e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684554:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c418e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684570:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:3.0:1787384498.684573:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384498.684577:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c418e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684585:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c418e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684602:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c4195 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684610:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c4195 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684627:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c4195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684633:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384498.684637:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c4195 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684644:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c4195 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684654:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e34836a500) 00010000:00010000:3.0:1787384498.684656:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384498.684659:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c4195 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684666:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030000/0x3522fbed3b6c4195 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684720:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c4187 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79031 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684737:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79031 expref: 54 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.684745:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:3.0:1787384498.684747:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384498.684750:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031000, rc 0) 00000100:00100000:3.0:1787384498.688643:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377962300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+54:11568:x1874208173940096:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 4990us (5248us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1787384498.688688:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 205 00000100:00100000:0.0:1787384498.695621:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384498.695738:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173940224 00000100:00100000:3.0:1787384498.695758:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173940224 00000100:00100000:3.0:1787384498.695855:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 206 00000100:00100000:3.0:1787384498.695928:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37313b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+54:11568:x1874208173940224:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:3.0:1787384498.696035:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.696057:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.696073:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.696114:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.696123:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.696135:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.696146:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384498.696154:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.696253:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.696269:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:3.0:1787384498.696290:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384498.696297:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.696303:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384498.696663:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37313b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+54:11568:x1874208173940224:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 737us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384498.696672:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 206 00000100:00100000:1.0:1787384498.705272:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384498.709059:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173940480 00000100:00100000:0.0:1787384498.709086:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173940480 00000100:00100000:0.0:1787384498.709424:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:0.0:1787384498.709438:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+54:11568:x1874208173940480:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:0.0:1787384498.709766:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377963100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+55:11568:x1874208173940480:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 331us (4509us total) trans 4294967498 rc 0/0 00000100:00100000:0.0:1787384498.709775:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 58 00000100:00100000:0.0:1787384498.799209:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384498.799386:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173940736 00000100:00100000:3.0:1787384498.799401:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173940736 00000100:00100000:3.0:1787384498.799479:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 207 00000100:00100000:3.0:1787384498.799492:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+55:11578:x1874208173940736:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:3.0:1787384498.799528:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384498.799532:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787384498.799567:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b800/0x3522fbed3b6c412c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79015 expref: 55 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.799589:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:3.0:1787384498.799595:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384498.799613:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41b1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79038 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.799795:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.799814:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79031 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.799836:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.799909:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79031 expref: 55 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.799925:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79031 expref: 55 pid: 5785 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384498.800702:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1874208195949312:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384498.801027:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2427310c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384498.808327:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4ece00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1874208195949312:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384498.808369:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384498.808436:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384498.809413:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173940864 00000100:00100000:1.0:1787384498.809428:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173940864 00010000:00010000:1.0:1787384498.809480:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79031 expref: 56 pid: 5785 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384498.809524:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00100000:1.0:1787384498.809535:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+56:2352:x1874208173940864:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384498.809556:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384498.809565:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79031 expref: 56 pid: 5785 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.809581:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79031 expref: 56 pid: 5785 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.809611:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c419c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79031 expref: 56 pid: 5785 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.809632:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:1.0:1787384498.809656:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.809669:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.809677:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.809704:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384498.811452:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+55:2352:x1874208173940864:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 1903us (3003us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384498.811469:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 77 00010000:00010000:1.0:1787384498.811539:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.811551:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384498.811578:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1787384498.811787:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c41b1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79038 expref: 56 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.811821:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79038 expref: 55 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.811831:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:1.0:1787384498.811834:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787384498.811838:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030200, rc 0) 00000100:00100000:1.0:1787384498.813248:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373138a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+55:11578:x1874208173940736:12345-192.168.203.51@tcp:101:bash.0 Request processed in 13748us (14042us total) trans 4294967499 rc 0/0 00000100:00100000:1.0:1787384498.813279:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 207 00000100:00100000:0.0:1787384498.820660:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384498.821040:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173941120 00000100:00100000:3.0:1787384498.821054:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173941120 00000100:00100000:3.0:1787384498.821133:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 208 00000100:00100000:3.0:1787384498.821145:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37313b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+55:11578:x1874208173941120:12345-192.168.203.51@tcp:36:bash.0 00010000:00010000:3.0:1787384498.821541:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.821563:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384498.821576:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787384498.821640:0:7691:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:3.0:1787384498.821669:0:7691:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c18be8d3 reply state 000000002392269d transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384498.821680:0:7691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787384498.821808:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37313b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+58:11578:x1874208173941120:12345-192.168.203.51@tcp:36:bash.0 Request processed in 664us (1163us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1787384498.821816:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 208 00000020:00080000:3.0:1787384498.821822:0:7691:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787384498.827823:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:2.0:1787384498.827893:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.827911:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.827920:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.827939:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384498.827965:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.827975:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.827998:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:2.0:1787384498.828002:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384498.828007:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.828014:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c41c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384498.828059:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173941248 00000100:00100000:2.0:1787384498.828073:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173941248 00000100:00100000:2.0:1787384498.828140:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 209 00000100:00100000:2.0:1787384498.828444:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+57:11578:x1874208173941248:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384498.828476:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384498.828500:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c41cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7903f expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.828607:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.828623:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79038 expref: 58 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.828632:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.828688:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79038 expref: 58 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.828706:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79038 expref: 58 pid: 5783 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384498.828725:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3731e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195949440:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384498.829042:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3779cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384498.834171:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384498.838725:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173941376 00000100:00100000:2.0:1787384498.839027:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173941376 00010000:00010000:2.0:1787384498.839098:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79038 expref: 59 pid: 5783 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384498.839142:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 78 00000100:00100000:2.0:1787384498.839223:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+59:2353:x1874208173941376:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384498.839245:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384498.839253:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79038 expref: 59 pid: 5783 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.839326:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79038 expref: 59 pid: 5783 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.839358:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:2.0:1787384498.839364:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.839405:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.839414:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.839444:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384498.839532:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373138000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+59:2353:x1874208173941376:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 381us (5381us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.839541:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 78 00010000:00010000:2.0:1787384498.841019:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030200/0x3522fbed3b6c41b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79038 expref: 58 pid: 5783 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384498.841052:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3731e4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195949440:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384498.841081:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.841092:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.841098:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384498.841324:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787384498.841330:0:5785:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384498.841357:0:5785:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.841398:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c41cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7903f expref: 58 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.841426:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7903f expref: 57 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.841435:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:2.0:1787384498.841438:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384498.841442:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2a00, rc 0) 00000100:00100000:2.0:1787384498.841505:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+57:11578:x1874208173941248:12345-192.168.203.51@tcp:101:bash.0 Request processed in 13354us (13699us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.841514:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 209 00000100:00100000:3.0:1787384498.847779:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384498.847824:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384498.847852:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384498.847901:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384498.849467:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173942016 00000100:00100000:2.0:1787384498.849487:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173942016 00000100:00100000:2.0:1787384498.849578:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 161 00000100:00100000:2.0:1787384498.849592:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173942016:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384498.849699:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173942016:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 109us (1845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.849708:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 161 00000100:00100000:3.0:1787384498.850021:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173941760 00000100:00100000:3.0:1787384498.850029:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173941760 00000100:00100000:3.0:1787384498.850071:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 300 00000100:00100000:3.0:1787384498.850078:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173941760:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384498.850112:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173941760:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 35us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384498.850119:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 300 00000100:00100000:3.0:1787384498.850324:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173941888 00000100:00100000:3.0:1787384498.850330:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173941888 00000100:00100000:2.0:1787384498.850599:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173941632 00000100:00100000:2.0:1787384498.850605:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173941632 00000100:00100000:2.0:1787384498.850642:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00100000:2.0:1787384498.850650:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+57:11578:x1874208173941632:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:3.0:1787384498.851039:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:3.0:1787384498.851050:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:2352:x1874208173941888:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384498.851101:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+9:2352:x1874208173941888:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 52us (3198us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384498.851109:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:2.0:1787384498.851166:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+58:11578:x1874208173941632:12345-192.168.203.51@tcp:35:bash.0 Request processed in 516us (3404us total) trans 4294967502 rc 0/0 00000100:00100000:2.0:1787384498.851174:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 59 00000100:00080000:2.0:1787384498.851235:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384498.851256:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787384498.874065:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:1.0:1787384498.874092:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787384498.874106:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1787384498.874117:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:3.0:1787384498.929743:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384498.930852:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173942144 00000100:00100000:2.0:1787384498.930894:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173942144 00000100:00100000:2.0:1787384498.931052:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 210 00000100:00100000:2.0:1787384498.931064:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+58:11584:x1874208173942144:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384498.931094:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384498.931119:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c41db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79046 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.931200:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c41e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.931227:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.931242:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384498.931318:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1787384498.931322:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384498.931342:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c41e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.931368:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c41db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79046 expref: 60 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.931387:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c41e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79046 expref: 59 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.931397:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384498.931417:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384498.931421:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2600, rc 0) 00000100:00100000:2.0:1787384498.931512:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+59:11584:x1874208173942144:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 450us (1784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.931520:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 210 00000100:00100000:3.0:1787384498.934131:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384498.935626:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173942272 00000100:00100000:2.0:1787384498.935653:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173942272 00000100:00100000:2.0:1787384498.935773:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 211 00000100:00100000:2.0:1787384498.935789:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+59:11584:x1874208173942272:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384498.935826:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384498.935886:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c41e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7904d expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936008:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c41f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936030:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c41f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936045:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c41f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936064:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c41f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936071:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c41f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936078:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c41f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936331:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936342:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936351:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384498.936411:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787384498.936416:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384498.936443:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936459:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936469:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c41f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936477:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c41f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936484:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c41f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936492:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2e00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384498.936497:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c41f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936518:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c41f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936543:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384498.936548:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384498.936555:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c41f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936562:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c41f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936579:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c41f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936586:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c41f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936592:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c41f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936597:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384498.936600:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c41f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936606:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c41f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936614:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e345695000) 00010000:00010000:2.0:1787384498.936617:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384498.936620:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c41f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936626:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c41f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936686:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c41e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7904d expref: 61 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936701:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7904d expref: 60 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.936710:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:2.0:1787384498.936712:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384498.936715:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3e00, rc 0) 00000100:00100000:2.0:1787384498.936816:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+60:11584:x1874208173942272:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1031us (2702us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.936825:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 211 00000100:00100000:2.0:1787384498.941305:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384498.941410:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173942528 00000100:00100000:0.0:1787384498.941423:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173942528 00000100:00100000:0.0:1787384498.941514:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 212 00000100:00100000:0.0:1787384498.941527:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3731e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+60:11584:x1874208173942528:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384498.941579:0:5785:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384498.941608:0:5785:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4205 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79054 expref: -99 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.941765:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.941785:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7903f expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.941794:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7904d expref: 61 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.941803:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 5/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.941846:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7904d expref: 61 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.941894:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7904d expref: 61 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384498.941913:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37313ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195949568:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384498.942071:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7903f expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.942082:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7903f expref: 61 pid: 5785 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384498.942106:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373139180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195949696:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384498.942134:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344f36540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384498.946164:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384498.946300:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173942656 00000100:00100000:1.0:1787384498.946312:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173942656 00010000:00010000:1.0:1787384498.946369:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7904d expref: 62 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384498.946425:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:1.0:1787384498.946448:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+62:2353:x1874208173942656:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384498.946468:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384498.946477:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7904d expref: 62 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.946495:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7904d expref: 62 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.946530:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:1.0:1787384498.946536:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.946548:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384498.946556:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384498.946628:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+62:2353:x1874208173942656:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 183us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384498.946655:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 79 00010000:00010000:0.0:1787384498.949323:0:5785:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.51@tcp) returned -22 from blocking AST (req@00000000da8f5929 x1874208195949568) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 1/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7904d expref: 61 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.949359:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c41fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7904d expref: 61 pid: 5783 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384498.949382:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37313ad80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195949568:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384498.949398:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373139180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195949696:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384498.949427:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:0.0:1787384498.949434:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.949444:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.949456:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384498.952111:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384498.952251:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173942784 00000100:00100000:2.0:1787384498.952266:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173942784 00010000:00010000:2.0:1787384498.952322:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7903f expref: 61 pid: 5785 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384498.952408:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:2.0:1787384498.952420:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+61:2352:x1874208173942784:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384498.952448:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384498.952457:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7903f expref: 61 pid: 5785 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.952475:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7903f expref: 61 pid: 5785 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.952534:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c41d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7903f expref: 61 pid: 5785 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.952567:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:2.0:1787384498.952574:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.952586:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.952595:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.952632:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384498.952684:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.952696:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384498.952709:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f54000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+60:2352:x1874208173942784:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 290us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.952723:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 80 00000004:00200000:0.0:1787384498.952739:0:5785:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787384498.953559:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4205 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79054 expref: 61 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.953586:0:5785:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79054 expref: 60 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.953596:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:0.0:1787384498.953599:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384498.953603:0:5785:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a400, rc 0) 00000100:00100000:0.0:1787384498.953700:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3731e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+60:11584:x1874208173942528:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 12175us (12413us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1787384498.953710:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 212 00000100:00100000:3.0:1787384498.957822:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384498.957944:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173943040 00000100:00100000:0.0:1787384498.957961:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173943040 00000100:00100000:0.0:1787384498.958044:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:0.0:1787384498.958055:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+60:11584:x1874208173943040:12345-192.168.203.51@tcp:103:lfs.0 00010000:00010000:0.0:1787384498.958076:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384498.958109:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c416b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7902a expref: 60 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.958132:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:0.0:1787384498.958137:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384498.959132:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441d9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+59:11584:x1874208173943040:12345-192.168.203.51@tcp:103:lfs.0 Request processed in 1070us (1317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384498.959145:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1787384498.961831:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384498.963628:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173943168 00000100:00100000:0.0:1787384498.963650:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173943168 00000100:00100000:0.0:1787384498.963749:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 213 00000100:00100000:0.0:1787384498.963763:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+59:11584:x1874208173943168:12345-192.168.203.51@tcp:58:lfs.0 00010000:00010000:0.0:1787384498.965490:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.965513:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384498.965529:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787384498.967927:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787384498.968476:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+59:11584:x1874208173943168:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 4709us (6651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384498.968491:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 213 00000100:00100000:1.0:1787384498.971005:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384498.971105:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173943296 00000100:00100000:2.0:1787384498.971117:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173943296 00000100:00100000:2.0:1787384498.971253:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 214 00000100:00100000:2.0:1787384498.971265:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+59:11584:x1874208173943296:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384498.971293:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384498.971319:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4221 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7905b expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.971397:0:7691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.971429:0:7691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4221 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7905b expref: 60 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.971452:0:7691:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.971467:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4221 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7905b expref: 60 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.971483:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:2.0:1787384498.971486:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384498.971491:0:7691:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4221 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7905b expref: 60 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384498.971499:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3800, rc 0) 00000100:00100000:2.0:1787384498.971613:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+60:11584:x1874208173943296:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 351us (682us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384498.971620:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 214 00010000:00010000:1.0:1787384499.209796:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787384499.914933:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787384499.914947:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787384499.914994:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787384499.915003:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384499.915185:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373139f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195949824:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787384499.915404:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3661c4cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384499.924595:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384499.924702:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173943424 00000100:00100000:2.0:1787384499.924714:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173943424 00000100:00100000:2.0:1787384499.924825:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 215 00000100:00100000:2.0:1787384499.924837:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37bbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+61:11585:x1874208173943424:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787384499.924913:0:5783:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787384499.925051:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37bbd8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+61:11585:x1874208173943424:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 216us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384499.925060:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 215 00000100:00100000:0.0:1787384499.925277:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373139f80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195949824:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00080000:3.0:1787384499.925572:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384499.931038:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384499.931184:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173943552 00000100:00100000:2.0:1787384499.931197:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173943552 00000100:00100000:2.0:1787384499.931395:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 216 00000100:00100000:2.0:1787384499.931408:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e344260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+60:11585:x1874208173943552:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787384499.931517:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c4228 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931541:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c4228 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931558:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c4228 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931576:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c422f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931584:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c422f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931590:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c422f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931618:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931627:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931634:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384499.931685:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787384499.931707:0:7691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384499.931723:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931749:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c4228 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931756:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c4228 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931764:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c4228 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931771:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2e00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384499.931777:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c4228 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931786:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c4228 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931803:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:2.0:1787384499.931807:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384499.931812:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c4228 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931818:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c4228 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931833:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c422f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931839:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c422f lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931855:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c422f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931970:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384499.931973:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c422f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931981:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c422f lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.931990:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff89e345695000) 00010000:00010000:2.0:1787384499.931992:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384499.931995:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c422f lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.932000:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c422f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.932023:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.932029:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.932034:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.932040:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384499.932042:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.932059:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.932069:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:2.0:1787384499.932072:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384499.932075:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.932081:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c4236 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384499.932192:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e344260000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+60:11585:x1874208173943552:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 784us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384499.932202:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 216 00000100:00100000:3.0:1787384499.937019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384499.937189:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173943808 00000100:00100000:2.0:1787384499.937201:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173943808 00000100:00100000:2.0:1787384499.937293:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 217 00000100:00100000:2.0:1787384499.937306:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+60:11585:x1874208173943808:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384499.937336:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384499.937365:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c423d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79062 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.937502:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.937520:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.937546:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384499.937583:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787384499.937721:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.937729:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.937891:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.937900:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384499.937905:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.937914:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.937928:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:2.0:1787384499.937932:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787384499.937937:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.937945:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.938001:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c423d lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79062 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.938015:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:2.0:1787384499.938018:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384499.938030:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c423d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79062 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.938041:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3a00, rc 0) 00000100:00100000:2.0:1787384499.938128:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+61:11585:x1874208173943808:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 824us (1124us total) trans 4294967504 rc 301/301 00000100:00100000:2.0:1787384499.938137:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 217 00000100:00100000:3.0:1787384499.943394:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384499.943487:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173943936 00000100:00100000:0.0:1787384499.943501:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173943936 00000100:00100000:0.0:1787384499.943575:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 218 00000100:00100000:0.0:1787384499.943586:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+61:11585:x1874208173943936:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787384499.943635:0:5785:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787384499.943779:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+61:11585:x1874208173943936:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 194us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384499.943789:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 218 00000100:00100000:3.0:1787384499.948997:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384499.955448:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173944192 00000100:00100000:2.0:1787384499.955473:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173944192 00000100:00100000:2.0:1787384499.955808:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 219 00000100:00100000:2.0:1787384499.955823:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+61:11585:x1874208173944192:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384499.955887:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384499.955891:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787384499.955943:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c41e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79046 expref: 61 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.955974:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384499.955981:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384499.956003:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4252 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79069 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787384499.957368:0:5783:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787384499.961726:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.961771:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.961789:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.961917:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4252 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79069 expref: 63 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.961953:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79069 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.961963:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e345695000) 00010000:00010000:2.0:1787384499.961966:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384499.961971:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2200, rc 0) 00000100:00100000:2.0:1787384499.962074:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+62:11585:x1874208173944192:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 6254us (13092us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787384499.962085:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 219 00000100:00100000:0.0:1787384499.974029:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384499.974432:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173944448 00000100:00100000:2.0:1787384499.974450:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173944448 00000100:00100000:2.0:1787384499.974530:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 220 00000100:00100000:2.0:1787384499.974542:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+62:11585:x1874208173944448:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787384499.974658:0:5785:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384499.974693:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c4259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79069 expref: 62 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.974717:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e345695000) 00010000:00010000:2.0:1787384499.974735:0:5785:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384499.974774:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4267 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.974790:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.974809:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.980832:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c426e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1a026e9d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.980881:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c426e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a026e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.980895:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c426e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a026e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.980987:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4267 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.980995:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4267 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981001:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981007:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3a00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384499.981012:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4267 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981019:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4267 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981032:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:2.0:1787384499.981035:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384499.981039:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4267 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981058:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4267 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981071:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c426e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a026e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981078:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c426e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a026e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981083:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c426e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a026e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981088:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384499.981091:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c426e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a026e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981097:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c426e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1a026e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981104:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1a026e9d (ffff89e345695700) 00010000:00010000:2.0:1787384499.981107:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384499.981109:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c426e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1a026e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384499.981114:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c426e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1a026e9d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384499.981244:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+61:11585:x1874208173944448:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 6698us (7227us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787384499.981253:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 220 00000100:00100000:1.0:1787384499.989660:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384499.989777:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173944576 00000100:00100000:0.0:1787384499.989790:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173944576 00000100:00100000:0.0:1787384499.989894:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 221 00000100:00100000:0.0:1787384499.989907:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+61:11585:x1874208173944576:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787384499.989945:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384499.989975:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4275 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79070 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384499.990018:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384499.990034:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384499.990047:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384499.990178:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4275 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79070 expref: 63 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384499.990200:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79070 expref: 62 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384499.990220:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751200) 00010000:00010000:0.0:1787384499.990224:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384499.990227:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108bc00, rc 0) 00000100:00100000:0.0:1787384499.990317:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+62:11585:x1874208173944576:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 412us (670us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384499.990336:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 221 00000100:00100000:1.0:1787384499.997463:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384499.997632:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173944832 00000100:00100000:2.0:1787384499.997646:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173944832 00000100:00100000:2.0:1787384499.997787:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 222 00000100:00100000:2.0:1787384499.997800:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+62:11585:x1874208173944832:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787384500.009070:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.009097:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.009111:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787384500.009459:0:7691:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1787384500.009469:0:7691:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361152609118ns, next at 362152606739ns, rc = 0 00000004:00010000:1.0:1787384500.009928:0:7691:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b846a338 reply state 000000000aabf24b transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384500.009951:0:7691:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787384500.010084:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+64:11585:x1874208173944832:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 12283us (12634us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787384500.010109:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 222 00010000:00010000:2.0:1787384500.016058:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.016077:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.016085:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.016090:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624ce00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384500.016095:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.016102:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.016131:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751200) 00010000:00010000:2.0:1787384500.016135:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787384500.016140:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.016147:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c4283 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384500.019293:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384500.019516:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173944960 00000100:00100000:1.0:1787384500.019533:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173944960 00000100:00100000:1.0:1787384500.019676:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 223 00000100:00100000:1.0:1787384500.019689:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+63:11585:x1874208173944960:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384500.019823:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384500.019845:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c428a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79077 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.020091:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c428a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79077 expref: 64 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.020112:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c428a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79077 expref: 64 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.020334:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751200) 00010000:00010000:1.0:1787384500.020338:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384500.020342:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624da00, rc 0) 00000100:00100000:1.0:1787384500.020533:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373138000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+64:11585:x1874208173944960:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 846us (1254us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384500.020541:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 223 00000100:00100000:1.0:1787384500.042000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384500.042127:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173945088 00000100:00100000:2.0:1787384500.042138:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173945088 00000100:00100000:2.0:1787384500.042228:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:2.0:1787384500.042238:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+9:2353:x1874208173945088:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787384500.042843:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+10:2353:x1874208173945088:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 603us (849us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787384500.042854:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00080000:3.0:1787384500.043987:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384500.050508:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384500.052569:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173945344 00000100:00100000:2.0:1787384500.052606:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173945344 00000100:00100000:2.0:1787384500.052720:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:2.0:1787384500.052733:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+64:11585:x1874208173945344:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787384500.053179:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+65:11585:x1874208173945344:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 445us (2685us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1787384500.053189:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 60 00000100:00100000:1.0:1787384500.056572:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384500.057089:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173945600 00000100:00100000:3.0:1787384500.057104:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173945600 00000100:00100000:3.0:1787384500.057188:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 224 00000100:00100000:3.0:1787384500.057200:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+65:11585:x1874208173945600:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787384500.059459:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+65:11585:x1874208173945600:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 2245us (2886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384500.059478:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 224 00000100:00100000:1.0:1787384500.062709:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384500.062977:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173945728 00000100:00100000:2.0:1787384500.062991:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173945728 00000100:00100000:2.0:1787384500.063112:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 225 00000100:00100000:2.0:1787384500.063125:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+65:11585:x1874208173945728:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384500.063155:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384500.063182:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4291 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7907e expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.063299:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.063316:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.063353:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384500.063402:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384500.063427:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.063459:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4291 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7907e expref: 67 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.063484:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7907e expref: 66 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.063494:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751200) 00010000:00010000:2.0:1787384500.063506:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787384500.063511:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3a00, rc 0) 00000100:00100000:2.0:1787384500.063607:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+66:11585:x1874208173945728:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 485us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384500.063616:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 225 00000100:00100000:0.0:1787384500.072939:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384500.073129:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173945856 00000100:00100000:3.0:1787384500.073143:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173945856 00000100:00100000:3.0:1787384500.073230:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:3.0:1787384500.073242:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+10:2352:x1874208173945856:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384500.073277:0:10631:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384500.073308:0:10631:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c429f lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79085 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384500.073343:0:10631:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a8952b3, blocks: 0x1 00010000:00010000:3.0:1787384500.073372:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1787384500.073377:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384500.073389:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c429f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79085 expref: 11 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.073411:0:10631:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c429f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79085 expref: 11 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.073429:0:10631:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030200, rc 0) 00000100:00100000:3.0:1787384500.073513:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+11:2352:x1874208173945856:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 273us (588us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384500.073544:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:0.0:1787384500.077487:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384500.077724:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173946112 00000100:00100000:1.0:1787384500.078401:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173946112 00000100:00100000:1.0:1787384500.078525:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 226 00000100:00100000:1.0:1787384500.078538:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37313ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+66:11585:x1874208173946112:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1787384500.078696:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37313ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+66:11585:x1874208173946112:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 161us (1228us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384500.078706:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 226 00000100:00100000:1.0:1787384500.103780:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384500.109525:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173946240 00000100:00100000:2.0:1787384500.109551:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173946240 00000100:00100000:3.0:1787384500.110014:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:3.0:1787384500.110029:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37275d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+11:11585:x1874208173946240:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384500.110056:0:6575:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384500.110085:0:6575:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7908c expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.110150:0:6575:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c429f lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79085 expref: 12 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.110162:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384500.110167:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384500.110174:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 12 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.110410:0:6575:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c429f lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79085 expref: 12 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.110427:0:6575:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c429f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79085 expref: 12 pid: 10631 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384500.110444:0:6575:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6575:1874208195949952:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384500.110678:0:6575:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731900 going to sleep for 11 seconds 00000100:00100000:0.0:1787384500.117016:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384500.117113:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173946368 00000100:00100000:1.0:1787384500.117125:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173946368 00010000:00010000:1.0:1787384500.117191:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c429f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79085 expref: 13 pid: 10631 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384500.117260:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:1.0:1787384500.117272:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+13:2352:x1874208173946368:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384500.117293:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384500.117323:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c429f lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79085 expref: 13 pid: 10631 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.117340:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c429f lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79085 expref: 13 pid: 10631 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.117374:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384500.117380:0:5768:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384500.117389:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 13 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.117401:0:5768:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 13 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.117481:0:5768:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 13 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384500.117499:0:5768:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5768:1874208195950080:192.168.203.51@tcp:105: 00000100:00100000:1.0:1787384500.117610:0:5768:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461ccc00 going to sleep for 11 seconds 00010000:00010000:3.0:1787384500.118444:0:6575:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c429f lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79085 expref: 13 pid: 10631 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384500.118487:0:6575:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6575:1874208195949952:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384500.118520:0:6575:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 12 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.118534:0:6575:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030000, rc 0) 00000100:00100000:3.0:1787384500.118607:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37275d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+12:11585:x1874208173946240:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 8581us (14842us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384500.118617:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:0.0:1787384500.133222:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384500.133660:0:6581:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173946496 00000100:00100000:3.0:1787384500.133675:0:6581:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173946496 00002000:00100000:3.0:1787384500.133758:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff89e37313b800 x1874208173946496/t0(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:531/0 lens 504/0 e 0 to 0 dl 1787384511 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384500.133771:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e37313b800 with x1874208173946496 ext(0->12) 00002000:00010000:3.0:1787384500.133780:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e37313b800 00000100:00100000:3.0:1787384500.133826:0:6581:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:3.0:1787384500.133838:0:6581:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37313b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddc9253f-47aa-4509-981d-645f91ec7250+12:2352:x1874208173946496:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1787384500.134516:0:6581:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37313b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:ddc9253f-47aa-4509-981d-645f91ec7250+14:2352:x1874208173946496:12345-192.168.203.51@tcp:4:lhsmtool_posix.0 Request processed in 677us (1315us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1787384500.134529:0:6581:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00002000:00100000:3.0:1787384500.134540:0:6581:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff89e37313b800 x1874208173946496/t4294967320(0) o4->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:531/0 lens 504/448 e 0 to 0 dl 1787384511 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787384500.134549:0:6581:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e37313b800 with x1874208173946496 ext(0->12) 00002000:00010000:3.0:1787384500.134559:0:6581:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e37313b800 00000100:00100000:1.0:1787384500.144299:0:5768:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315f480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5768:1874208195950080:192.168.203.51@tcp:105: 00010000:00010000:1.0:1787384500.144338:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384500.144439:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373138e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+13:2352:x1874208173946368:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 27168us (27438us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384500.144454:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:0.0:1787384500.148388:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384500.148505:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173946624 00000100:00100000:1.0:1787384500.148518:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173946624 00000100:00100000:1.0:1787384500.148592:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 227 00000100:00100000:1.0:1787384500.148617:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+66:11585:x1874208173946624:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787384500.224808:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000004:00080000:1.0:1787384500.224838:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:1.0:1787384500.224884:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e346bcb6c0 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787384500.224890:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e3450aa900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e3412edc00 00000020:00080000:1.0:1787384500.224894:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e3450aa600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e349f72c00 00000020:00080000:1.0:1787384500.224922:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000001:00080000:1.0:1787384500.224931:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787384500.224934:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000004:00080000:1.0:1787384500.224945:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787384500.224959:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e344f480c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787384500.224981:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e3461e5600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e344f48e40 00000020:00080000:1.0:1787384500.224984:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e3461e5300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e37b59cc00 00000100:00100000:2.0:1787384500.225334:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3731e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195950336:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787384500.225426:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384500.225502:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787384500.225508:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3731e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195950208:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1787384500.225531:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384500.225641:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195950336 00000100:00100000:3.0:1787384500.225653:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195950336 00000100:00100000:3.0:1787384500.225729:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195950208 00000100:00100000:3.0:1787384500.225732:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195950208 00000100:00100000:3.0:1787384500.225753:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787384500.225763:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1874208195950336:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1787384500.226010:0:10631:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1787384500.226014:0:10631:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787384499 00002000:00010000:3.0:1787384500.226017:0:10631:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1787384500.226020:0:10631:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787384499 -> 1787384499 00002000:00010000:3.0:1787384500.226022:0:10631:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1787384500.226074:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1874208195950336:12345-0@lo:2:osp-syn-1-0.0 Request processed in 312us (648us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1787384500.226082:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1787384500.226101:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787384500.226109:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3307:x1874208195950208:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1787384500.226124:0:10631:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:3.0:1787384500.226147:0:10631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.226173:0:10631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c406f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78feb expref: 12 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.226183:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:3.0:1787384500.226188:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384500.226194:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.226306:0:10631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c406f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78feb expref: 12 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.226322:0:10631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78feb expref: 12 pid: 6575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384500.226337:0:10631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10631:1874208195950464:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384500.226412:0:10631:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731900 going to sleep for 11 seconds 00000004:00080000:3.0:1787384500.226472:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e3731e6680/2, rc 0, transno 4294967321 00000100:00100000:3.0:1787384500.226479:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3731e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195950336:0@lo:2:osp-syn-1-0.0 00000001:00080000:1.0:1787384500.226727:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000100:00080000:2.0:1787384500.227153:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384500.227176:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384500.227191:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195950592:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787384500.227254:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384500.230149:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195950592 00000100:00100000:1.0:1787384500.230172:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195950592 00000100:00100000:1.0:1787384500.230285:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787384500.230299:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3742d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195950592:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787384500.230348:0:6575:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1787384500.230406:0:6575:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a8952b1, atime: 0x0, ctime: 0x6a8952b1, blocks: 0xb 00010000:00010000:1.0:1787384500.230418:0:6575:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c42b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.230442:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1787384500.230448:0:6575:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787384500.230457:0:6575:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c42b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.230481:0:6575:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c42b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.230496:0:6575:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c42b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.230506:0:6575:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c42b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.230545:0:6575:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1787384500.230901:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787384500.230971:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384500.230981:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c42b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.230992:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384500.231010:0:5772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c42b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.231022:0:5772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c42b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.231048:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c42b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.231071:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019f1775a/0x3522fbed3b6c42b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.231099:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384500.231101:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384500.231103:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384500.233772:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3742d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195950592:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3463us (6503us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787384500.233791:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787384500.237008:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373138700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+20:11585:x1874208173946624:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 88359us (88601us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384500.237027:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 227 00000020:00080000:0.0:1787384500.237101:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1787384500.237406:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00010000:00010000:1.0:1787384500.238504:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384500.238700:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1787384500.238712:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:2.0:1787384500.238757:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e37c5afb80, transno 4294967307 00000004:00080000:2.0:1787384500.238774:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1787384500.238797:0:3305:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff89e37315f480 x1874208195950592/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787384516 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:2.0:1787384500.238814:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e37315f480/2, rc 0, transno 4294967310 00000100:00100000:2.0:1787384500.238823:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195950592:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787384500.244082:0:10631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10631:1874208195950464:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384500.244125:0:10631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384500.252459:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384500.253404:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173946752 00000100:00100000:1.0:1787384500.253422:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173946752 00000100:00100000:1.0:1787384500.253505:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:1.0:1787384500.253518:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37313a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+13:2353:x1874208173946752:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787384500.253757:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384500.254148:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173946880 00000100:00100000:1.0:1787384500.254154:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173946880 00010000:00010000:1.0:1787384500.254189:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78feb expref: 14 pid: 6575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384500.254241:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:1.0:1787384500.254249:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37313a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+14:2353:x1874208173946880:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384500.254267:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384500.254274:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c406f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78feb expref: 14 pid: 6575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.254291:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c406f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78feb expref: 14 pid: 6575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.254325:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c406f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78feb expref: 14 pid: 6575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.254349:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384500.254376:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787384500.254383:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.254394:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.254426:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384500.254500:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37313a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+13:2353:x1874208173946880:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 245us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384500.254510:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 82 00010000:00010000:3.0:1787384500.254687:0:10631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.254699:0:10631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.254711:0:10631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.254720:0:10631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.254808:0:10631:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384500.258170:0:8293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384500.258195:0:8293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.258223:0:8293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384500.258230:0:8293:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.258245:0:8293:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.258275:0:8293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.258284:0:8293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085a6da2b/0x3522fbed3b6c42ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.258346:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384500.258349:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384500.258351:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384500.258718:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3307:x1874208195950208:12345-0@lo:6:osp-syn-1-0.0 Request processed in 32603us (33178us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1787384500.258752:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:2.0:1787384500.266159:0:3307:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e3731e4380/2, rc 0, transno 4294967322 00000100:00100000:2.0:1787384500.266186:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3731e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195950208:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1787384500.431826:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000001:00080000:2.0:1787384500.431885:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:2.0:1787384500.431894:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:2.0:1787384500.431903:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000100:00100000:1.0:1787384500.432286:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37313a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173946752:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 178759us (179834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384500.432301:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:1.0:1787384500.446494:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384500.447589:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173947136 00000100:00100000:2.0:1787384500.447607:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173947136 00000100:00100000:2.0:1787384500.447707:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 228 00000100:00100000:2.0:1787384500.447720:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+20:11585:x1874208173947136:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787384500.448184:0:5783:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384500.448240:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3a00/0x3522fbed3b6c4298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7907e expref: 20 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.448274:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751200) 00010000:00010000:2.0:1787384500.448282:0:5783:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384500.448334:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.448352:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.448363:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787384500.449281:0:5783:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003193be4c reply state 000000008def0ff0 transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384500.449299:0:5783:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384500.449498:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+21:11585:x1874208173947136:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 1776us (3016us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1787384500.449508:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 228 00010000:00010000:0.0:1787384500.453750:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.453780:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.453789:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.453796:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384500.453803:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.453812:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.453882:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751200) 00010000:00010000:0.0:1787384500.453886:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384500.453892:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.453900:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c42bb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384500.454329:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384500.454495:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173947264 00000100:00100000:3.0:1787384500.454510:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173947264 00000100:00100000:3.0:1787384500.454581:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:3.0:1787384500.454594:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173947264:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1787384500.455367:0:6576:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1787384500.455374:0:6576:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787384499 -> 1787384498 00002000:00010000:3.0:1787384500.455377:0:6576:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787384497 00002000:00010000:3.0:1787384500.455380:0:6576:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787384499 -> 1787384498 00002000:00010000:3.0:1787384500.455383:0:6576:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1787384500.455518:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173947264:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 924us (1193us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1787384500.455527:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 70 00000100:00100000:1.0:1787384500.460401:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384500.460506:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173947520 00000100:00100000:0.0:1787384500.460520:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173947520 00000100:00100000:0.0:1787384500.460681:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 229 00000100:00100000:0.0:1787384500.460694:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+20:11585:x1874208173947520:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1787384500.461352:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.461383:0:7691:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79070 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.461395:0:7691:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.461449:0:7691:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79070 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.461467:0:7691:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79070 expref: 20 pid: 5784 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384500.461486:0:7691:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373139c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195950720:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384500.461690:0:7691:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aef180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384500.465507:0:7691:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373139c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7691:1874208195950720:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384500.465556:0:7691:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384500.467201:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384500.467794:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173947648 00000100:00100000:2.0:1787384500.467810:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173947648 00010000:00010000:2.0:1787384500.468188:0:5769:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79070 expref: 21 pid: 5784 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384500.468348:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:0.0:1787384500.468363:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+21:2352:x1874208173947648:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384500.468386:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384500.468394:0:5769:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79070 expref: 21 pid: 5784 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.468410:0:5769:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79070 expref: 21 pid: 5784 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.468438:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108bc00/0x3522fbed3b6c427c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79070 expref: 21 pid: 5784 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.468458:0:5769:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751200) 00010000:00010000:0.0:1787384500.468464:0:5769:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.468475:0:5769:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.468483:0:5769:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.468565:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384500.468661:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ddc9253f-47aa-4509-981d-645f91ec7250+20:2352:x1874208173947648:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 302us (1473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384500.468670:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 83 00010000:00010000:2.0:1787384500.469871:0:7691:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.469889:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.469990:0:7691:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.470132:0:7691:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.470142:0:7691:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.470149:0:7691:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384500.470155:0:7691:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.470182:0:7691:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.470210:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751200) 00010000:00010000:2.0:1787384500.470214:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1787384500.470220:0:7691:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.470226:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c42c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384500.470339:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+19:11585:x1874208173947520:12345-192.168.203.51@tcp:55:lhsmtool_posix.0 Request processed in 9643us (9949us total) trans 0 rc -22/-22 00000100:00100000:2.0:1787384500.470350:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 229 00000100:00100000:1.0:1787384500.475348:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384500.475441:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173947776 00000100:00100000:3.0:1787384500.475456:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173947776 00000100:00100000:3.0:1787384500.475537:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:3.0:1787384500.475550:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173947776:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787384500.475615:0:10631:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.475646:0:10631:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 8 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.475657:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384500.475663:0:10631:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384500.475688:0:10631:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.475750:0:10631:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 8 pid: 6575 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.475768:0:10631:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 8 pid: 6575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384500.475788:0:10631:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10631:1874208195950848:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384500.475948:0:10631:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384500.480820:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384500.480962:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173947904 00000100:00100000:2.0:1787384500.480983:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173947904 00010000:00010000:2.0:1787384500.481033:0:5770:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 9 pid: 6575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384500.481092:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:2.0:1787384500.481103:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+9:2353:x1874208173947904:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384500.481123:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384500.481152:0:5770:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 9 pid: 6575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.481169:0:5770:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 9 pid: 6575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384500.481440:0:10631:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10631:1874208195950848:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384500.481613:0:10631:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.482388:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c594446c/0x3522fbed3b6c42a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7908c expref: 9 pid: 6575 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.482417:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384500.482422:0:5770:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384500.482429:0:5770:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.482442:0:5770:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.482755:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787384500.482838:0:10631:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.482850:0:10631:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.482939:0:10631:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.482949:0:10631:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.482977:0:10631:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.482985:0:10631:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384500.482990:0:10631:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.483000:0:10631:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.483015:0:10631:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.483023:0:10631:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086ace9c5/0x3522fbed3b6c42c9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10631 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384500.483272:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173947904:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 2166us (2463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384500.483286:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:3.0:1787384500.483330:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173947776:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 7780us (7995us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384500.483342:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 71 00000100:00100000:0.0:1787384500.488120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384500.488405:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173948160 00000100:00100000:3.0:1787384500.488420:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173948160 00000100:00100000:3.0:1787384500.488631:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 230 00000100:00100000:3.0:1787384500.488645:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+19:11585:x1874208173948160:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787384500.488769:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c42d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.488815:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c42d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.488831:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c42d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.489394:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.489411:0:5785:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c428a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79077 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.489422:0:5785:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.489475:0:5785:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c428a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79077 expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.489640:0:5785:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c428a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79077 expref: 20 pid: 5784 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384500.489664:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195950976:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384500.490182:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384500.495217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384500.495816:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173948288 00000100:00100000:3.0:1787384500.495831:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173948288 00010000:00010000:3.0:1787384500.495941:0:5768:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c428a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79077 expref: 21 pid: 5784 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384500.495987:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 85 00000100:00100000:3.0:1787384500.496169:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+21:2352:x1874208173948288:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384500.496193:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384500.496212:0:5768:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c428a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79077 expref: 21 pid: 5784 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.496231:0:5768:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c428a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79077 expref: 21 pid: 5784 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.496262:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751200) 00010000:00010000:3.0:1787384500.496268:0:5768:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.496280:0:5768:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.496290:0:5768:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.496314:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384500.496384:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+21:2352:x1874208173948288:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 219us (1191us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384500.496392:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 85 00010000:00010000:2.0:1787384500.498582:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c428a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79077 expref: 20 pid: 5784 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384500.498615:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195950976:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384500.498650:0:5785:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.498800:0:5785:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.498809:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787384500.499430:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1787384500.499814:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1787384500.500102:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1787384500.500278:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37313aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195951104:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787384500.500368:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384500.500461:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aefe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384500.500588:0:5789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195951104 00000100:00100000:2.0:1787384500.500599:0:5789:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195951104 00000100:00100000:2.0:1787384500.500696:0:5789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384500.500707:0:5789:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1874208195951104:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1787384500.500857:0:5789:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5785:x1874208195951104:12345-0@lo:1000:mdt00_002.0 Request processed in 151us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384500.500890:0:5789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384500.501011:0:5785:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:3.0:1787384500.501019:0:5785:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967322 00000004:00080000:3.0:1787384500.501044:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e3731e6680, transno 4294967321 00000004:00080000:3.0:1787384500.501066:0:5785:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e3731e4380, transno 4294967322 00000100:00100000:3.0:1787384500.501075:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37313aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195951104:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1787384500.501704:0:5785:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1787384500.501803:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195951232:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1787384500.501902:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384500.504189:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e242731000 going to sleep for 11 seconds 00000100:00100000:0.0:1787384500.504455:0:5788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195951232 00000100:00100000:0.0:1787384500.504469:0:5788:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195951232 00000100:00100000:0.0:1787384500.504623:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787384500.504635:0:5788:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5785:x1874208195951232:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1787384500.505313:0:5788:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5785:x1874208195951232:12345-0@lo:1000:mdt00_002.0 Request processed in 677us (3407us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787384500.505324:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1787384500.505469:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5785:1874208195951232:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1787384500.505608:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.505621:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.505630:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.505636:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384500.505641:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.505650:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.505671:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751200) 00010000:00010000:3.0:1787384500.505675:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384500.505681:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.505688:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031000/0x3522fbed3b6c42d7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.505728:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.506237:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.506265:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.506271:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384500.506275:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.506281:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.506294:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:3.0:1787384500.506297:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384500.506307:0:5785:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4221 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7905b expref: 23 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.506320:0:5785:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4221 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7905b expref: 23 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.506330:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7905b expref: 23 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.509259:0:5785:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4221 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7905b expref: 23 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384500.509292:0:5785:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373139180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195951360:192.168.203.51@tcp:105: 00000100:00100000:1.0:1787384500.509463:0:5785:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aef180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384500.522446:0:5785:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373139180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5785:1874208195951360:192.168.203.51@tcp:105: 00010000:00010000:0.0:1787384500.522506:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522520:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c421a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522605:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c42de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522624:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c42de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522639:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c42de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522654:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c42de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522661:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c42de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522669:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c42de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522676:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ac00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384500.522681:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c42de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522689:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c42de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522703:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:0.0:1787384500.522707:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384500.522711:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c42de lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.522716:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c42de lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.523197:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c42d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.523215:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c42d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.523220:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c42d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.523225:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384500.523228:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c42d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.523233:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c42d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.523243:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:0.0:1787384500.523246:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384500.523249:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c42d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.523254:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c42d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384500.523817:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+23:11585:x1874208173948160:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 35169us (35706us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1787384500.523830:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 230 00000020:00080000:0.0:1787384500.523839:0:5785:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787384500.526820:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384500.528351:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173948416 00000100:00100000:0.0:1787384500.528371:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173948416 00000100:00100000:0.0:1787384500.528495:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:0.0:1787384500.528516:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+23:11584:x1874208173948416:12345-192.168.203.51@tcp:49:lfs.0 00000100:00100000:0.0:1787384500.528698:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+23:11584:x1874208173948416:12345-192.168.203.51@tcp:49:lfs.0 Request processed in 185us (1894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384500.528706:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 61 00000100:00100000:1.0:1787384500.530792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384500.531436:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173948672 00000100:00100000:0.0:1787384500.531452:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173948672 00000100:00100000:0.0:1787384500.531547:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 62 00000100:00100000:0.0:1787384500.531559:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350f76450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+23:11585:x1874208173948672:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787384500.532495:0:5786:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787384500.532622:0:5786:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:0.0:1787384500.532688:0:5786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.532711:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.532726:0:5786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.532735:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.532742:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.532749:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.532768:0:5786:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787384500.532975:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350f76450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+25:11585:x1874208173948672:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 1413us (2192us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1787384500.532986:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 62 00000020:00080000:0.0:1787384500.532994:0:5786:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787384500.535903:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:1.0:1787384500.536478:0:8292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384500.536501:0:8292:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.536516:0:8292:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384500.536522:0:8292:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.536534:0:8292:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.536560:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff89e357751400) 00010000:00010000:1.0:1787384500.536563:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787384500.536568:0:8292:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.536575:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a600/0x3522fbed3b6c42e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384500.536610:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384500.536612:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384500.536614:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384500.537650:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173948928 00000100:00100000:0.0:1787384500.537667:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173948928 00000100:00100000:0.0:1787384500.537738:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 231 00000040:00080000:2.0:1787384500.537787:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384500.537794:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1787384500.537825:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+25:11584:x1874208173948928:12345-192.168.203.51@tcp:58:lfs.0 00000040:00080000:0.0:1787384500.538483:0:5784:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000040:00080000:2.0:1787384500.538556:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1787384500.538571:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384500.538898:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+25:11584:x1874208173948928:12345-192.168.203.51@tcp:58:lfs.0 Request processed in 1070us (3043us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384500.538911:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 231 00000100:00100000:0.0:1787384500.600147:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384500.600368:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173949056 00000100:00100000:2.0:1787384500.600383:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173949056 00000100:00100000:2.0:1787384500.600468:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 232 00000100:00100000:2.0:1787384500.600480:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+25:11587:x1874208173949056:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384500.600528:0:5783:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384500.600558:0:5783:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c42ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79093 expref: -99 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.600642:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c42f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.600660:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c42f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.600675:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c42f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.600695:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c42fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.600703:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c42fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.600750:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c42fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.601369:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.601386:0:5783:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79054 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.601395:0:5783:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.601441:0:5783:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79054 expref: 26 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384500.601459:0:5783:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79054 expref: 26 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384500.601475:0:5783:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37b2bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1874208195951488:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384500.601681:0:5783:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e345a2c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384500.609289:0:5783:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37b2bdf80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5783:1874208195951488:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384500.609339:0:5783:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384500.610830:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384500.611245:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173949312 00000100:00100000:2.0:1787384500.611263:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173949312 00000100:00100000:2.0:1787384500.611338:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:2.0:1787384500.611350:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+27:9206:x1874208173949312:12345-192.168.203.51@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787384500.611757:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+28:9206:x1874208173949312:12345-192.168.203.51@tcp:35:ldlm_bl.0 Request processed in 407us (938us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787384500.611767:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 63 00000100:00100000:1.0:1787384500.617838:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384500.618355:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173949440 00000100:00100000:0.0:1787384500.618369:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173949440 00010000:00010000:0.0:1787384500.618426:0:7472:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79054 expref: 28 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384500.618476:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 86 00000100:00100000:0.0:1787384500.618486:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+28:2352:x1874208173949440:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384500.618515:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384500.618523:0:7472:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79054 expref: 28 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.618537:0:7472:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79054 expref: 28 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.618589:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c420c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79054 expref: 28 pid: 5785 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.618607:0:7472:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:0.0:1787384500.618613:0:7472:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.618623:0:7472:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.618631:0:7472:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384500.618677:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384500.618763:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ddc9253f-47aa-4509-981d-645f91ec7250+27:2352:x1874208173949440:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 277us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384500.618771:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 86 00010000:00010000:3.0:1787384500.619838:0:5783:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.619853:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384500.619952:0:5783:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787384500.619972:0:5783:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384500.620012:0:5783:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620029:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620041:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c42f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620048:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c42f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620056:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c42f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620062:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384500.620067:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c42f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620076:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c42f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620092:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:3.0:1787384500.620095:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384500.620100:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c42f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620107:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3400/0x3522fbed3b6c42f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620119:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c42fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620135:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c42fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620141:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c42fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620145:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2e00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384500.620148:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c42fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620153:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c42fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620162:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff89e345695c00) 00010000:00010000:3.0:1787384500.620164:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384500.620167:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c42fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620174:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2e00/0x3522fbed3b6c42fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620237:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2800/0x3522fbed3b6c42ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79093 expref: 27 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620254:0:5783:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79093 expref: 26 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384500.620262:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:3.0:1787384500.620265:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384500.620276:0:5783:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2a00, rc 0) 00000100:00100000:3.0:1787384500.620345:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+26:11587:x1874208173949056:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 19865us (20211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384500.620354:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 232 00000100:00100000:0.0:1787384500.824106:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384500.824138:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195951616:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787384500.824243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384500.824369:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195951616 00000100:00100000:3.0:1787384500.824381:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195951616 00000100:00100000:3.0:1787384500.824453:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787384500.824466:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37313bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195951616:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384500.824516:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384500.824571:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37313bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195951616:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384500.824579:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1787384500.824681:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195951616:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384501.257141:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384501.332310:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195952000:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.332425:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.332509:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384501.332518:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195952128:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.332547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.332584:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195951872:0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.334370:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195951744:0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.334480:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384501.334543:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195952256:0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.334572:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384501.334649:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195952000 00000100:00100000:3.0:1787384501.334660:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195952000 00000100:00100000:3.0:1787384501.334729:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195952256 00000100:00100000:3.0:1787384501.334732:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195952256 00000100:00100000:3.0:1787384501.334758:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787384501.334767:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195952000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.334838:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195952000:12345-0@lo:400:kworker.0 Request processed in 71us (2413us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384501.334847:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787384501.334883:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787384501.334889:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195952256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.334940:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195952256:12345-0@lo:400:kworker.0 Request processed in 51us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384501.334947:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1787384501.334967:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195951744 00000100:00100000:3.0:1787384501.334970:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195951744 00000100:00100000:3.0:1787384501.334995:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:3.0:1787384501.335003:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195951744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.335032:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195951744:12345-0@lo:400:kworker.0 Request processed in 32us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384501.335038:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00080000:3.0:1787384501.335070:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384501.335123:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195952000:0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.335164:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195951744:0@lo:400:kworker.0 00000100:00100000:3.0:1787384501.335174:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195952256:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.344824:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195952128 00000100:00100000:2.0:1787384501.344844:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195952128 00000100:00100000:2.0:1787384501.344938:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787384501.344951:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195952128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.345074:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1874208195952128:12345-0@lo:400:kworker.0 Request processed in 126us (12525us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384501.345082:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787384501.346480:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195952128:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.359114:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384501.359173:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195951872 00000100:00100000:2.0:1787384501.359186:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195951872 00000100:00100000:2.0:1787384501.359261:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787384501.359273:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195951872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.359344:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37b2bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195951872:12345-0@lo:400:kworker.0 Request processed in 73us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384501.359353:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1787384501.359424:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195951872:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.359450:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195952384:0@lo:400:kworker.0 00000100:00100000:2.0:1787384501.359489:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384501.360407:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195952384 00000100:00100000:1.0:1787384501.360419:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195952384 00000100:00100000:1.0:1787384501.360479:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787384501.360490:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874208195952384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384501.360572:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377963100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3307:x1874208195952384:12345-0@lo:400:kworker.0 Request processed in 84us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384501.360580:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787384501.361578:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195952384:0@lo:400:kworker.0 00000040:00080000:2.0:1787384501.577815:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384501.577829:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384501.578020:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787384501.578030:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787384501.578458:0:11530:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377963b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195952512:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787384501.578620:0:11530:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346beb900 going to sleep for 11 seconds 00000100:00100000:2.0:1787384501.590454:0:11530:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377963b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11530:1874208195952512:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787384501.592052:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384501.592378:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173949568 00000100:00100000:0.0:1787384501.592390:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173949568 00000100:00100000:0.0:1787384501.592487:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 233 00000100:00100000:0.0:1787384501.592501:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+26:11598:x1874208173949568:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787384501.592569:0:5783:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787384501.592750:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+26:11598:x1874208173949568:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 252us (718us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384501.592758:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 233 00000100:00080000:3.0:1787384501.592805:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384501.611441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384501.614778:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173949824 00000100:00100000:3.0:1787384501.614799:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173949824 00000100:00100000:3.0:1787384501.614906:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 234 00000100:00100000:3.0:1787384501.614921:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37313aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+26:11598:x1874208173949824:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384501.614952:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384501.614984:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c4308 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7909a expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384501.615398:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c430f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384501.615418:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c430f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384501.615434:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c430f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384501.615450:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1787384501.615657:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340031400/0x3522fbed3b6c4308 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7909a expref: 29 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384501.615677:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c430f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7909a expref: 28 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384501.615687:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:3.0:1787384501.615690:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384501.615695:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030400, rc 0) 00000100:00100000:3.0:1787384501.617977:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37313aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+28:11598:x1874208173949824:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 3040us (6533us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1787384501.617995:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 234 00000100:00100000:3.0:1787384501.630792:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384501.631148:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173950080 00000100:00100000:0.0:1787384501.631161:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173950080 00000100:00100000:0.0:1787384501.631262:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 235 00000100:00100000:0.0:1787384501.631275:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+28:11598:x1874208173950080:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787384501.631393:0:5783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c431d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384501.631416:0:5783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c431d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384501.631431:0:5783:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c431d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384501.631820:0:5783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c431d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384501.631832:0:5783:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c431d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384501.631840:0:5783:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c431d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384501.631846:0:5783:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384501.631852:0:5783:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c431d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384501.631897:0:5783:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c431d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384501.631913:0:5783:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:0.0:1787384501.631916:0:5783:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787384501.631922:0:5783:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c431d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384501.631928:0:5783:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c431d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5783 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384501.638585:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+29:11598:x1874208173950080:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 7293us (7792us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1787384501.638605:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 235 00000100:00100000:1.0:1787384501.646562:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384501.646952:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173950208 00000100:00100000:3.0:1787384501.646967:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173950208 00000100:00100000:3.0:1787384501.647053:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:3.0:1787384501.647067:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+29:2352:x1874208173950208:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384501.647100:0:5768:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384501.647757:0:5768:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e340030400/0x3522fbed3b6c430f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7909a expref: 29 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384501.647781:0:5768:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:3.0:1787384501.647788:0:5768:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384501.647903:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441db850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ddc9253f-47aa-4509-981d-645f91ec7250+28:2352:x1874208173950208:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 839us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384501.647912:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1787384501.655986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384501.657744:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173950464 00000100:00100000:0.0:1787384501.657762:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173950464 00000100:00100000:0.0:1787384501.657833:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:0.0:1787384501.657846:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+28:11598:x1874208173950464:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787384501.658213:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+29:11598:x1874208173950464:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 368us (2241us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787384501.658221:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 64 00000100:00100000:0.0:1787384501.833364:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384501.833398:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195952640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384501.833495:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384501.833611:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195952640 00000100:00100000:1.0:1787384501.833623:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195952640 00000100:00100000:1.0:1787384501.833689:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384501.833700:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195952640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384501.833740:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1787384501.833798:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373138e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1874208195952640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384501.833806:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787384501.833928:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195952640:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1787384501.862069:0:12418:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384501.862082:0:12418:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384501.862137:0:12418:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787384501.862144:0:12418:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384502.082441:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384502.095484:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173950720 00000100:00100000:1.0:1787384502.095508:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173950720 00000100:00100000:1.0:1787384502.095602:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 236 00000100:00100000:1.0:1787384502.095614:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37313a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+29:11611:x1874208173950720:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:1.0:1787384502.095651:0:5784:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384502.095678:0:5784:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c4324 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee790a1 expref: -99 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384502.095820:0:5784:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c432b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384502.095838:0:5784:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c432b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384502.095854:0:5784:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c432b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5784 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384502.095890:0:5784:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787384502.096073:0:5784:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c4324 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790a1 expref: 32 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384502.096096:0:5784:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c432b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790a1 expref: 31 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384502.096104:0:5784:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:1.0:1787384502.096108:0:5784:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787384502.096111:0:5784:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624ce00, rc 0) 00000100:00100000:1.0:1787384502.096208:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37313a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+31:11611:x1874208173950720:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 596us (13782us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787384502.096216:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 236 00000100:00100000:1.0:1787384502.106692:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384502.112101:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173950848 00000100:00100000:0.0:1787384502.112124:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173950848 00000100:00100000:0.0:1787384502.112249:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 237 00000100:00100000:0.0:1787384502.112261:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+31:11611:x1874208173950848:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:0.0:1787384502.112359:0:5785:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384502.112381:0:5785:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384502.112396:0:5785:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384502.112433:0:5785:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384502.112440:0:5785:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4339 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384502.112447:0:5785:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384502.112453:0:5785:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384502.112458:0:5785:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384502.112466:0:5785:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384502.112479:0:5785:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:0.0:1787384502.112483:0:5785:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384502.112487:0:5785:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4339 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384502.112505:0:5785:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b000/0x3522fbed3b6c4339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5785 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384502.112621:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+31:11611:x1874208173950848:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 362us (5938us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384502.112629:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 237 00000100:00100000:1.0:1787384502.249241:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384502.249386:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173950976 00000100:00100000:2.0:1787384502.249400:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173950976 00000100:00080000:3.0:1787384502.249472:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384502.249552:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:2.0:1787384502.249567:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2351:x1874208173950976:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:2.0:1787384502.249597:0:6574:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384502.252350:0:6574:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4340 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee790a8 expref: -99 pid: 6574 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787384502.252410:0:6574:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a8952b2, atime: 0x6a8952b1, ctime: 0x6a8952b2, blocks: 0xb 00010000:00010000:2.0:1787384502.252456:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1787384502.252462:0:6574:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384502.252482:0:6574:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4340 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790a8 expref: 8 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384502.252543:0:6574:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4340 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790a8 expref: 8 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384502.252563:0:6574:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2000, rc 0) 00000100:00100000:2.0:1787384502.252677:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+8:2351:x1874208173950976:12345-192.168.203.51@tcp:101:cat.0 Request processed in 3113us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384502.252689:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 72 00000100:00100000:2.0:1787384502.261020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384502.261255:0:6580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173951104 00000100:00100000:0.0:1787384502.261273:0:6580:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173951104 00002000:00100000:0.0:1787384502.261364:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff89e377963b80 x1874208173951104/t0(0) o3->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:533/0 lens 488/0 e 0 to 0 dl 1787384513 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787384502.261377:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e377963b80 with x1874208173951104 ext(0->4095) 00002000:00010000:0.0:1787384502.261385:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e377963b80 00000100:00100000:0.0:1787384502.261428:0:6580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1787384502.261440:0:6580:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173951104:12345-192.168.203.51@tcp:3:cat.0 00000100:00100000:0.0:1787384502.261771:0:6580:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377963b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:2353:x1874208173951104:12345-192.168.203.51@tcp:3:cat.0 Request processed in 330us (765us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787384502.261779:0:6580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00002000:00100000:0.0:1787384502.261796:0:6580:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff89e377963b80 x1874208173951104/t0(0) o3->ddc9253f-47aa-4509-981d-645f91ec7250@192.168.203.51@tcp:533/0 lens 488/4536 e 0 to 0 dl 1787384513 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787384502.261803:0:6580:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff89e377963b80 with x1874208173951104 ext(0->4095) 00002000:00010000:0.0:1787384502.261807:0:6580:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff89e377963b80 00010000:00010000:1.0:1787384502.281151:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787384502.665662:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787384502.665678:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384502.666721:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787384502.666736:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787384503.305098:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384503.972966:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384503.973006:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384503.973036:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384503.973056:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384503.973079:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384503.973112:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173951616 00000100:00100000:2.0:1787384503.973123:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173951616 00000100:00100000:2.0:1787384503.973190:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173951488 00000100:00100000:2.0:1787384503.973194:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173951488 00000100:00100000:2.0:1787384503.973228:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:2.0:1787384503.973239:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173951616:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384503.973336:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377963800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+8:2352:x1874208173951616:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 98us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384503.973345:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:2.0:1787384503.973366:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:2.0:1787384503.973373:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2352:x1874208173951488:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384503.973414:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ddc9253f-47aa-4509-981d-645f91ec7250+5:2352:x1874208173951488:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 41us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384503.973421:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:2.0:1787384503.973442:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173951232 00000100:00100000:2.0:1787384503.973445:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173951232 00000100:00100000:2.0:1787384503.973474:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 302 00000100:00100000:2.0:1787384503.973481:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173951232:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384503.973507:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173951232:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 27us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384503.973514:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 302 00000100:00100000:2.0:1787384503.973550:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173951360 00000100:00100000:2.0:1787384503.973554:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173951360 00000100:00100000:2.0:1787384503.973583:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173951744 00000100:00100000:2.0:1787384503.973586:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173951744 00000100:00100000:2.0:1787384503.973608:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 165 00000100:00100000:2.0:1787384503.973614:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+31:2352:x1874208173951360:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384503.973647:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377963480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ddc9253f-47aa-4509-981d-645f91ec7250+31:2352:x1874208173951360:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 33us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384503.973654:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 165 00000100:00100000:2.0:1787384503.973666:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 166 00000100:00100000:2.0:1787384503.973672:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37273d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173951744:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384503.973696:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37273d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2352:x1874208173951744:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384503.973702:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 166 00000100:00080000:2.0:1787384503.973722:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787384503.973733:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:1.0:1787384503.996576:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:1.0:1787384504.329244:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384505.355388:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787384505.495930:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:1.0:1787384505.495976:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000001:00080000:1.0:1787384505.495990:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1787384505.496021:0:5806:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff89e242731cc0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1787384505.496028:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e37c4a5500 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff89e242731480 00000020:00080000:1.0:1787384505.496031:0:5806:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff89e37c4a5b00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff89e3732e7c00 00000020:00080000:0.0:1787384505.496346:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1787384505.497664:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1787384505.522166:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1787384505.522204:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000100:00100000:2.0:1787384505.936886:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384505.936924:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195952768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384505.937024:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384505.940990:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195952768 00000100:00100000:1.0:1787384505.941012:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195952768 00000100:00100000:1.0:1787384505.941094:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787384505.941122:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195952768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384505.941189:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384505.941321:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195952768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (4298us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384505.941330:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1787384505.942884:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384505.942954:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1787384505.942966:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff89e37315f480, transno 4294967310 00000100:00100000:2.0:1787384505.943008:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195952768:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384506.379436:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384506.442182:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195953280:0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.442324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384506.442386:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195953024:0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.442402:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384506.442407:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195953152:0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.442470:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195952896:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.443893:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384506.443993:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195953280 00000100:00100000:2.0:1787384506.444005:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195953280 00000100:00100000:2.0:1787384506.444079:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195953024 00000100:00100000:2.0:1787384506.444083:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195953024 00000100:00100000:2.0:1787384506.444115:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787384506.444125:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195953280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.444495:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195953280:12345-0@lo:400:kworker.0 Request processed in 371us (2170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384506.444506:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787384506.444530:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1787384506.444537:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195953024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.444573:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195953024:12345-0@lo:400:kworker.0 Request processed in 36us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384506.444579:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00080000:2.0:1787384506.444603:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384506.444648:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195953024:0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.451321:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384506.451413:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195953408:0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.451477:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384506.451542:0:6575:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195953408 00000100:00100000:1.0:1787384506.451551:0:6575:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195953408 00000100:00100000:1.0:1787384506.451625:0:6575:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1787384506.451637:0:6575:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195953408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.451984:0:6575:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195953408:12345-0@lo:400:kworker.0 Request processed in 347us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384506.451993:0:6575:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1787384506.452024:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384506.452066:0:3306:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787384506.452074:0:3306:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1787384506.452104:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195953408:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.452288:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195952896 00000100:00100000:2.0:1787384506.452314:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195952896 00000100:00100000:2.0:1787384506.452350:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1787384506.452358:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195952896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.452408:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195952896:12345-0@lo:400:kworker.0 Request processed in 52us (1099us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384506.452428:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1787384506.452991:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195952896:0@lo:400:kworker.0 00000100:00100000:0.0:1787384506.459190:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384506.459301:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195953280:0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.459613:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195953152 00000100:00100000:2.0:1787384506.459624:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195953152 00000100:00100000:2.0:1787384506.459710:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1787384506.459722:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195953152:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384506.459789:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195953152:12345-0@lo:400:kworker.0 Request processed in 69us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384506.459797:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00080000:1.0:1787384506.459892:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384506.460560:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195953152:0@lo:400:kworker.0 00000100:00100000:1.0:1787384506.955050:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384506.955084:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195953536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384506.955197:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384506.955243:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195953536 00000100:00100000:0.0:1787384506.955256:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195953536 00000100:00100000:0.0:1787384506.955313:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1787384506.955323:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195953536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384506.955372:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384506.955435:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195953536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 113us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384506.955443:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787384506.955523:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195953536:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787384507.403076:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384507.618087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384507.618163:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173951872 00000100:00100000:2.0:1787384507.618178:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173951872 00000100:00100000:2.0:1787384507.618286:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 238 00000100:00100000:2.0:1787384507.618300:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+18:11271:x1874208173951872:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1787384507.618466:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+18:11271:x1874208173951872:12345-192.168.203.51@tcp:60:lhsmtool_posix.0 Request processed in 170us (397us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384507.618475:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 238 00000100:00080000:1.0:1787384507.618744:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384507.624765:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384507.624901:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173952128 00000100:00100000:0.0:1787384507.624919:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173952128 00000100:00100000:1.0:1787384507.625184:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:1.0:1787384507.625198:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+18:11271:x1874208173952128:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787384507.625898:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+19:11271:x1874208173952128:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 697us (1142us total) trans 4294967521 rc 0/0 00000100:00100000:1.0:1787384507.625909:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 65 00000100:00100000:0.0:1787384508.008755:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384508.009055:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173952256 00000100:00100000:2.0:1787384508.009068:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173952256 00000100:00100000:2.0:1787384508.009171:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 239 00000100:00100000:2.0:1787384508.009184:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:12064:x1874208173952256:12345-192.168.203.51@tcp:101:lsof.0 00010000:00010000:2.0:1787384508.009223:0:7691:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384508.009274:0:7691:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c4347 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee790af expref: -99 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384508.009362:0:7691:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c434e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384508.009380:0:7691:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c434e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384508.009395:0:7691:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c434e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384508.009664:0:7691:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787384508.009669:0:7691:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384508.009756:0:7691:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c434e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7691 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384508.009786:0:7691:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3e00/0x3522fbed3b6c4347 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790af expref: 7 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384508.009806:0:7691:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c434e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790af expref: 6 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384508.009815:0:7691:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:2.0:1787384508.009818:0:7691:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384508.009822:0:7691:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2400, rc 0) 00000100:00100000:2.0:1787384508.009967:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:12064:x1874208173952256:12345-192.168.203.51@tcp:101:lsof.0 Request processed in 786us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384508.009975:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 239 00000100:00080000:1.0:1787384508.010361:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787384508.425579:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384509.089829:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384509.089920:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384509.089971:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384509.090000:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384509.090028:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384509.090062:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173952640 00000100:00100000:0.0:1787384509.090076:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173952640 00000100:00100000:0.0:1787384509.090162:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173952768 00000100:00100000:0.0:1787384509.090166:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173952768 00000100:00100000:3.0:1787384509.090186:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173952896 00000100:00100000:3.0:1787384509.090194:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173952896 00000100:00100000:0.0:1787384509.090229:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 86 00000100:00100000:3.0:1787384509.090235:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173952512 00000100:00100000:3.0:1787384509.090240:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173952512 00000100:00100000:0.0:1787384509.090244:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2352:x1874208173952640:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384509.090271:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 170 00000100:00100000:3.0:1787384509.090281:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2352:x1874208173952896:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384509.090390:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173952384 00000100:00100000:2.0:1787384509.090400:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173952384 00000100:00100000:2.0:1787384509.090437:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 304 00000100:00100000:2.0:1787384509.090444:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173952384:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384509.090485:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+5:2352:x1874208173952640:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 247us (565us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384509.090493:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 86 00000100:00100000:0.0:1787384509.090510:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:0.0:1787384509.090516:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173952768:12345-192.168.203.51@tcp:400:kworker.0 00000100:00080000:1.0:1787384509.090760:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384509.090767:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384509.090770:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384509.090782:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 171 00000100:00100000:1.0:1787384509.090791:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+19:2352:x1874208173952512:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384509.095114:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2352:x1874208173952896:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 4816us (5124us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384509.095135:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 170 00000100:00100000:2.0:1787384509.095963:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2352:x1874208173952384:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 5509us (6140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384509.095977:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 304 00000100:00100000:0.0:1787384509.096119:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373361c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ddc9253f-47aa-4509-981d-645f91ec7250+7:2352:x1874208173952768:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 5599us (6086us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384509.096130:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:1.0:1787384509.097549:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ddc9253f-47aa-4509-981d-645f91ec7250+19:2352:x1874208173952512:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 6745us (7533us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384509.097565:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 171 00010000:00010000:1.0:1787384509.449571:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384510.473217:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1787384510.658686:0:5806:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1787384510.658722:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000001:00080000:1.0:1787384510.658725:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1787384510.658741:0:5817:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:2.0:1787384511.050031:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195953664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384511.050151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384511.050413:0:6578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195953664 00000100:00100000:0.0:1787384511.050426:0:6578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195953664 00000100:00100000:0.0:1787384511.050530:0:6578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1787384511.050542:0:6578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195953664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384511.050592:0:6578:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787384511.050818:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384511.051022:0:6578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195953664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 481us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384511.051031:0:6578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1787384511.051345:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373362a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195953664:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384511.498582:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384511.564956:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195954048:0@lo:400:kworker.0 00000100:00100000:3.0:1787384511.565085:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384511.565174:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384511.565181:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195953920:0@lo:400:kworker.0 00000100:00100000:3.0:1787384511.565208:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384511.565259:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195954048 00000100:00100000:3.0:1787384511.565268:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195954048 00000100:00100000:3.0:1787384511.565333:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195953920 00000100:00100000:3.0:1787384511.565336:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195953920 00000100:00100000:3.0:1787384511.565359:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787384511.565368:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195954048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384511.565428:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3307:x1874208195954048:12345-0@lo:400:kworker.0 Request processed in 60us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384511.565435:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1787384511.565454:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787384511.565460:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195953920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384511.565487:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195953920:12345-0@lo:400:kworker.0 Request processed in 27us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384511.565493:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1787384511.565561:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195953920:0@lo:400:kworker.0 00000100:00100000:3.0:1787384511.565572:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3307:1874208195954048:0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.566173:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195953792:0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.566250:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384511.566296:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195954304:0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.566325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384511.566358:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787384511.566365:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195954176:0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.566396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787384511.566424:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384511.566438:0:5783:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195954176 00000100:00100000:1.0:1787384511.566443:0:5783:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195954176 00000100:00100000:1.0:1787384511.566486:0:5783:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1787384511.566494:0:5783:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195954176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384511.566542:0:5783:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195954176:12345-0@lo:400:kworker.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384511.566549:0:5783:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00080000:1.0:1787384511.566568:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384511.566591:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195954176:0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.566747:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195954304 00000100:00100000:0.0:1787384511.566752:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195954304 00000100:00100000:0.0:1787384511.566812:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787384511.566821:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195954304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384511.566890:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195954304:12345-0@lo:400:kworker.0 Request processed in 71us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384511.566912:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1787384511.566956:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195954304:0@lo:400:kworker.0 00000100:00080000:1.0:1787384511.567176:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384511.567348:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195953792 00000100:00100000:3.0:1787384511.567355:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195953792 00000100:00100000:3.0:1787384511.567398:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:3.0:1787384511.567407:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195953792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384511.567469:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3305:x1874208195953792:12345-0@lo:400:kworker.0 Request processed in 64us (1219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384511.567487:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:0.0:1787384511.567609:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3305:1874208195953792:0@lo:400:kworker.0 00000040:00080000:2.0:1787384511.884328:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384511.884341:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384511.884828:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 2 00000040:00080000:2.0:1787384511.884836:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787384512.073195:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195954432:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384512.073285:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384512.073410:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195954432 00000100:00100000:1.0:1787384512.073419:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195954432 00000100:00100000:1.0:1787384512.073475:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787384512.073493:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195954432:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384512.073547:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384512.073599:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195954432:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (313us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384512.073607:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787384512.073660:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195954432:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787384512.521173:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787384512.880823:0:12619:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 03:41:49 (1787384509) 00010000:00010000:3.0:1787384513.546556:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384514.208492:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384514.208536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384514.208647:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173953024 00000100:00100000:3.0:1787384514.208657:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173953024 00000100:00100000:3.0:1787384514.208710:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 306 00000100:00100000:3.0:1787384514.208721:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173953024:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384514.208812:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+13:2353:x1874208173953024:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 92us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384514.208819:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 306 00000100:00100000:0.0:1787384514.209084:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384514.209104:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384514.209141:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384514.209219:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173953536 00000100:00100000:3.0:1787384514.209225:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173953536 00000100:00100000:3.0:1787384514.209260:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 175 00000100:00100000:3.0:1787384514.209266:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2353:x1874208173953536:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384514.209303:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2353:x1874208173953536:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 37us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384514.209309:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 175 00000100:00100000:3.0:1787384514.209334:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173953152 00000100:00100000:3.0:1787384514.209338:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173953152 00000100:00100000:3.0:1787384514.209358:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 176 00000100:00100000:3.0:1787384514.209364:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+18:2353:x1874208173953152:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384514.209388:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373363480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ddc9253f-47aa-4509-981d-645f91ec7250+18:2353:x1874208173953152:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 25us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384514.209395:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 176 00000100:00100000:1.0:1787384514.220937:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173953280 00000100:00100000:1.0:1787384514.220952:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173953280 00000100:00100000:1.0:1787384514.221028:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173953408 00000100:00100000:1.0:1787384514.221032:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173953408 00000100:00100000:1.0:1787384514.221068:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:1.0:1787384514.221078:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173953280:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384514.221182:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373361880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+5:2353:x1874208173953280:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 106us (12644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384514.221190:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:1.0:1787384514.221208:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00100000:1.0:1787384514.221216:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173953408:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384514.221246:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+7:2353:x1874208173953408:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 31us (12106us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384514.221252:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00080000:1.0:1787384514.221276:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787384514.221281:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384514.221283:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787384514.569124:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384515.593044:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384516.169363:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195954560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384516.169438:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384516.172584:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195954560 00000100:00100000:2.0:1787384516.172598:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195954560 00000100:00100000:2.0:1787384516.172683:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787384516.172694:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195954560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787384516.172733:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384516.172822:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195954560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (3384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384516.172830:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787384516.173031:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195954560:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787384516.173283:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787384516.621267:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384516.681385:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195955072:0@lo:400:kworker.0 00000100:00100000:2.0:1787384516.681582:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195954688:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.681657:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195954816:0@lo:400:kworker.0 00000100:00100000:1.0:1787384516.681701:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195954944:0@lo:400:kworker.0 00000100:00100000:2.0:1787384516.683996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384516.684066:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195955200:0@lo:400:kworker.0 00000100:00100000:2.0:1787384516.684226:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384516.684280:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195954688 00000100:00100000:2.0:1787384516.684288:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195954688 00000100:00100000:2.0:1787384516.684348:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787384516.684356:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195954688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384516.684404:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195954688:12345-0@lo:400:kworker.0 Request processed in 48us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384516.684609:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787384516.684660:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195954688:0@lo:400:kworker.0 00000100:00100000:2.0:1787384516.684706:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195955200 00000100:00100000:2.0:1787384516.684710:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195955200 00000100:00100000:2.0:1787384516.684759:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787384516.684766:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195955200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384516.684805:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195955200:12345-0@lo:400:kworker.0 Request processed in 40us (578us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384516.684810:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787384516.684834:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195955200:0@lo:400:kworker.0 00000100:00080000:2.0:1787384516.684879:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384516.688163:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384516.688606:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195955072 00000100:00100000:2.0:1787384516.688615:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195955072 00000100:00100000:2.0:1787384516.688678:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:2.0:1787384516.688688:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195955072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384516.688762:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195955072:12345-0@lo:400:kworker.0 Request processed in 77us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384516.688769:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:3.0:1787384516.688853:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384516.688919:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195955072:0@lo:400:kworker.0 00000100:00100000:0.0:1787384516.691134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384516.693028:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195954816 00000100:00100000:3.0:1787384516.693044:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195954816 00000100:00100000:3.0:1787384516.693139:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787384516.693148:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195954816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384516.693235:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1874208195954816:12345-0@lo:400:kworker.0 Request processed in 88us (2105us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384516.693242:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787384516.693441:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3305:1874208195954816:0@lo:400:kworker.0 00000100:00100000:1.0:1787384516.697202:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384516.698023:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195954944 00000100:00100000:2.0:1787384516.698034:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195954944 00000100:00080000:3.0:1787384516.698124:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384516.698164:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1787384516.698175:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195954944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384516.698264:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195954944:12345-0@lo:400:kworker.0 Request processed in 91us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384516.698272:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1787384516.698346:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195954944:0@lo:400:kworker.0 00000100:00100000:0.0:1787384517.194784:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195955328:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384517.195417:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384517.195717:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195955328 00000100:00100000:3.0:1787384517.195730:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195955328 00000100:00100000:3.0:1787384517.195804:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787384517.195815:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195955328:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384517.195886:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384517.195954:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195955328:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384517.195962:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787384517.196058:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195955328:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787384517.641337:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384517.910445:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384517.911052:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173953792 00000100:00100000:1.0:1787384517.911064:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173953792 00000100:00100000:1.0:1787384517.911146:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00100000:1.0:1787384517.911157:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+18:12286:x1874208173953792:12345-192.168.203.51@tcp:35:umount.0 00000100:00100000:1.0:1787384517.911742:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+19:12286:x1874208173953792:12345-192.168.203.51@tcp:35:umount.0 Request processed in 584us (1306us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1787384517.911756:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 66 00000100:00080000:3.0:1787384517.912525:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384517.921725:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384517.922413:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173954048 00000100:00100000:2.0:1787384517.922427:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173954048 00000100:00100000:2.0:1787384517.922549:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:2.0:1787384517.922559:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+19:12286:x1874208173954048:12345-192.168.203.51@tcp:35:umount.0 00000100:00100000:2.0:1787384517.923215:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+20:12286:x1874208173954048:12345-192.168.203.51@tcp:35:umount.0 Request processed in 654us (1497us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1787384517.923225:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 67 00000100:00100000:0.0:1787384517.937479:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384517.939594:0:5787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173954304 00000100:00100000:3.0:1787384517.939608:0:5787:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173954304 00000100:00100000:3.0:1787384517.939684:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:3.0:1787384517.939711:0:5787:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e350f75450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+20:12286:x1874208173954304:12345-192.168.203.51@tcp:35:umount.0 00000100:00100000:3.0:1787384517.940437:0:5787:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e350f75450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ddc9253f-47aa-4509-981d-645f91ec7250+21:12286:x1874208173954304:12345-192.168.203.51@tcp:35:umount.0 Request processed in 724us (2963us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1787384517.940447:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 68 00000100:00100000:0.0:1787384517.944701:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384517.944752:0:5786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173954560 00000100:00100000:2.0:1787384517.944763:0:5786:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173954560 00000100:00100000:2.0:1787384517.944821:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:2.0:1787384517.944832:0:5786:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+21:12286:x1874208173954560:12345-192.168.203.51@tcp:35:umount.0 00000100:00100000:2.0:1787384517.945216:0:5786:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ddc9253f-47aa-4509-981d-645f91ec7250+22:12286:x1874208173954560:12345-192.168.203.51@tcp:35:umount.0 Request processed in 384us (524us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1787384517.945223:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 69 00000100:00100000:1.0:1787384517.952906:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384517.952950:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384517.954645:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173954688 00000100:00100000:0.0:1787384517.954661:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173954688 00000100:00100000:0.0:1787384517.954734:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173954816 00000100:00100000:0.0:1787384517.954738:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173954816 00000100:00100000:0.0:1787384517.954779:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:0.0:1787384517.954789:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+14:2350:x1874208173954688:12345-192.168.203.51@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1787384517.954821:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00010000:00010000:0.0:1787384517.954822:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787384517.954831:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96efe439-3b25-4671-a225-6795623d17b0+14:2350:x1874208173954816:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384517.954839:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384517.954880:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3429d4400/0x3522fbed3b6c332c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c02 expref: 14 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384517.954900:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384517.954930:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384517.954962:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96efe439-3b25-4671-a225-6795623d17b0+13:2350:x1874208173954816:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 132us (2010us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384517.954980:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00010000:00010000:0.0:1787384517.954995:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108ba00/0x3522fbed3b6c3372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c3a expref: 14 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384517.954998:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173955328 00000100:00100000:1.0:1787384517.955001:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173955328 00010000:00010000:0.0:1787384517.955007:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384517.955018:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:1.0:1787384517.955024:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96efe439-3b25-4671-a225-6795623d17b0+12:2350:x1874208173955328:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384517.955036:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384517.955050:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108be00/0x3522fbed3b6c35b0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d05 expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384517.955058:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384517.962457:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384517.962504:0:6576:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173955200 00000100:00100000:3.0:1787384517.962514:0:6576:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173955200 00000100:00100000:3.0:1787384517.962573:0:6576:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:3.0:1787384517.962583:0:6576:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+7:2349:x1874208173955200:12345-192.168.203.51@tcp:9:umount.0 00000020:00000080:3.0:1787384517.962614:0:6576:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3906 00000020:00010000:3.0:1787384517.962621:0:6576:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89e3727a9000: total 0 00000100:00080000:3.0:1787384517.962625:0:6576:0:(import.c:65:import_set_state_nolock()) ffff89e3727ab000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787384517.964567:0:6576:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1787384517.980760:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:96efe439-3b25-4671-a225-6795623d17b0+11:2350:x1874208173955328:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 25722us (25818us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384517.980775:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00080000:2.0:1787384517.981136:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00010000:2.0:1787384517.981180:0:5771:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89e3727a9000: total 0 00010000:00010000:2.0:1787384517.981228:0:5771:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89e3727a9000, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1787384517.981287:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4340 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790a8 expref: 5 pid: 6574 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384517.981324:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c3ca2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78eda expref: 4 pid: 10631 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384517.981361:0:5771:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89e3727a9000, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1787384517.981373:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384517.981375:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384517.981377:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384517.984463:0:6576:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:ddc9253f-47aa-4509-981d-645f91ec7250+2:2349:x1874208173955200:12345-192.168.203.51@tcp:9:umount.0 Request processed in 21869us (22002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384517.984478:0:6576:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 73 00000100:00100000:0.0:1787384517.985731:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:96efe439-3b25-4671-a225-6795623d17b0+10:2350:x1874208173954688:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 30932us (32824us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384517.985746:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1787384517.990040:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384517.990187:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173955456 00000100:00100000:1.0:1787384517.990197:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173955456 00000100:00100000:1.0:1787384517.990274:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00100000:1.0:1787384517.990284:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+5:2349:x1874208173955456:12345-192.168.203.51@tcp:9:umount.0 00000020:00000080:1.0:1787384517.990316:0:10631:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c369e 00000100:00080000:1.0:1787384517.990325:0:10631:0:(import.c:65:import_set_state_nolock()) ffff89e3727a8000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787384517.990367:0:10631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1787384517.990645:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ddc9253f-47aa-4509-981d-645f91ec7250+2:2349:x1874208173955456:12345-192.168.203.51@tcp:9:umount.0 Request processed in 361us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384517.990654:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 74 00000100:00080000:2.0:1787384517.990829:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787384517.990890:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384518.020826:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384518.020921:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173956480 00000100:00100000:3.0:1787384518.020931:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173956480 00000100:00100000:3.0:1787384518.020988:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 240 00000100:00100000:3.0:1787384518.020997:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+22:2349:x1874208173956480:12345-192.168.203.51@tcp:39:umount.0 00000020:00000080:3.0:1787384518.021031:0:5784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c333a 00000020:00010000:3.0:1787384518.021046:0:5784:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89e3441a3000: total 0 00000100:00080000:3.0:1787384518.021051:0:5784:0:(import.c:65:import_set_state_nolock()) ffff89e3441a7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787384518.021078:0:5784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:3.0:1787384518.021461:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ddc9253f-47aa-4509-981d-645f91ec7250+21:2349:x1874208173956480:12345-192.168.203.51@tcp:39:umount.0 Request processed in 463us (644us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1787384518.021483:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 240 00000020:00010000:1.0:1787384518.022926:0:8292:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89e3441a3000: total 0 00010000:00010000:1.0:1787384518.022983:0:8292:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89e3441a3000, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1787384518.023021:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e345695500) 00010000:00010000:1.0:1787384518.023025:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384518.023035:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121200/0x3522fbed3b6c3620 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d1a expref: 20 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023066:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:1.0:1787384518.023069:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384518.023073:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2a00/0x3522fbed3b6c4301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79093 expref: 19 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023119:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:1.0:1787384518.023122:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384518.023126:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a800/0x3522fbed3b6c3d04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ef6 expref: 18 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023140:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:1.0:1787384518.023142:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787384518.023146:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624c600/0x3522fbed3b6c3c63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ec5 expref: 17 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023157:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:1.0:1787384518.023159:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787384518.023163:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c3c8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78ed3 expref: 16 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023175:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:1.0:1787384518.023177:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787384518.023181:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fd200/0x3522fbed3b6c3fff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78fcf expref: 15 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023194:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:1.0:1787384518.023196:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1787384518.023199:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ce00/0x3522fbed3b6c432b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790a1 expref: 14 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023210:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:1.0:1787384518.023213:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787384518.023236:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c3961 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e01 expref: 13 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023251:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e34836a700) 00010000:00010000:1.0:1787384518.023254:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787384518.023257:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e3413fc000/0x3522fbed3b6c3604 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d13 expref: 12 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023274:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff89e345695600) 00010000:00010000:1.0:1787384518.023276:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787384518.023279:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121400/0x3522fbed3b6c3d20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78efd expref: 11 pid: 5784 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023293:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff89e357751600) 00010000:00010000:1.0:1787384518.023295:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384518.023298:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366120600/0x3522fbed3b6c3b83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78e8d expref: 10 pid: 5785 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023313:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff89e345695800) 00010000:00010000:1.0:1787384518.023315:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1787384518.023318:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e366121e00/0x3522fbed3b6c3674 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78d2f expref: 9 pid: 5783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023332:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff89e345695300) 00010000:00010000:1.0:1787384518.023335:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384518.023338:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4221 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7905b expref: 8 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384518.023352:0:8292:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89e3441a3000, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1787384518.023373:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384518.023375:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384518.023377:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384518.665484:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787384519.298011:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:1.0:1787384519.298020:0:6600:0:(genops.c:906:class_export_put()) final put ffff89e3727a9800/ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:0.0:1787384519.310144:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3727a9800/ddc9253f-47aa-4509-981d-645f91ec7250 for lustre-OST0000 00000020:00000080:0.0:1787384519.310220:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e3727a8000 for lustre-OST0000 00000100:00100000:1.0:1787384519.326566:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384519.326615:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384519.326840:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173956736 00000100:00100000:0.0:1787384519.326850:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173956736 00000100:00100000:0.0:1787384519.326967:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 180 00000100:00100000:0.0:1787384519.326979:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2352:x1874208173956736:12345-192.168.203.51@tcp:400:kworker.0 00000100:00080000:2.0:1787384519.327010:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384519.327063:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2352:x1874208173956736:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 86us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384519.327070:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 180 00000100:00100000:3.0:1787384519.329002:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173956608 00000100:00100000:3.0:1787384519.329015:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173956608 00000100:00100000:3.0:1787384519.329088:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 308 00000100:00100000:3.0:1787384519.329099:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:2352:x1874208173956608:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384519.329171:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:96efe439-3b25-4671-a225-6795623d17b0+10:2352:x1874208173956608:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 73us (2617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384519.329178:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 308 00010000:00010000:2.0:1787384519.692809:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384520.713075:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384520.823423:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384520.823456:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384520.823481:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384520.823507:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173956864 00000100:00100000:3.0:1787384520.823515:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173956864 00000100:00100000:3.0:1787384520.823569:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173957120 00000100:00100000:3.0:1787384520.823573:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173957120 00000100:00100000:3.0:1787384520.823583:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173956992 00000100:00100000:3.0:1787384520.823585:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173956992 00000100:00100000:3.0:1787384520.823615:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1787384520.823625:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96efe439-3b25-4671-a225-6795623d17b0+12:2351:x1874208173956864:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384520.823640:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384520.823659:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624c000/0x3522fbed3b6c340c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c4f expref: 12 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.823679:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384520.823735:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96efe439-3b25-4671-a225-6795623d17b0+11:2351:x1874208173956864:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 110us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384520.823759:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1787384520.823777:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:3.0:1787384520.823783:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96efe439-3b25-4671-a225-6795623d17b0+10:2351:x1874208173957120:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384520.823791:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384520.823802:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c35a9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78cfe expref: 10 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.823811:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384520.823829:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96efe439-3b25-4671-a225-6795623d17b0+9:2351:x1874208173957120:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 47us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384520.823848:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:3.0:1787384520.823894:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:3.0:1787384520.823901:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96efe439-3b25-4671-a225-6795623d17b0+8:2351:x1874208173956992:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384520.823908:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384520.823918:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624c200/0x3522fbed3b6c3413 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c79 expref: 8 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.823927:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384520.823944:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:96efe439-3b25-4671-a225-6795623d17b0+7:2351:x1874208173956992:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 44us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384520.823951:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:3.0:1787384520.830310:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384520.830346:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173957376 00000100:00100000:3.0:1787384520.830355:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173957376 00000100:00100000:3.0:1787384520.830417:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 241 00000100:00100000:3.0:1787384520.830427:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+6:2349:x1874208173957376:12345-192.168.203.51@tcp:39:umount.0 00000020:00000080:3.0:1787384520.830477:0:5784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3421 00000020:00010000:3.0:1787384520.830486:0:5784:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89e37293e800: total 0 00000100:00080000:3.0:1787384520.830490:0:5784:0:(import.c:65:import_set_state_nolock()) ffff89e37293a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787384520.830509:0:5784:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1787384520.830954:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5b85b8ac-6b36-499b-99d6-8bdc07d5605c+5:2349:x1874208173957376:12345-192.168.203.51@tcp:39:umount.0 Request processed in 526us (655us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1787384520.830964:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 241 00000020:00010000:3.0:1787384520.831010:0:8292:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89e37293e800: total 0 00010000:00010000:3.0:1787384520.831046:0:8292:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89e37293e800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1787384520.831090:0:8292:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e343ce4200) 00010000:00010000:3.0:1787384520.831094:0:8292:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384520.831101:0:8292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c434e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790af expref: 4 pid: 7691 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384520.831123:0:8292:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89e37293e800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1787384520.831134:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384520.831136:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384520.831137:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384520.856014:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384520.862051:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173957632 00000100:00100000:3.0:1787384520.862074:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173957632 00000100:00100000:3.0:1787384520.862129:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 309 00000100:00100000:3.0:1787384520.862138:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+7:2349:x1874208173957632:12345-192.168.203.51@tcp:251:umount.0 00000020:00000080:3.0:1787384520.862180:0:5776:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3317 00000020:00010000:3.0:1787384520.862188:0:5776:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89e3441a4000: total 0 00000100:00080000:3.0:1787384520.862192:0:5776:0:(import.c:65:import_set_state_nolock()) ffff89e3441a1000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1787384520.862275:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:96efe439-3b25-4671-a225-6795623d17b0+3:2349:x1874208173957632:12345-192.168.203.51@tcp:251:umount.0 Request processed in 138us (6270us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384520.862283:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 309 00000020:00010000:2.0:1787384520.862720:0:5772:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89e3441a4000: total 0 00010000:00010000:2.0:1787384520.862727:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384520.862775:0:5772:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89e3441a4000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787384520.862813:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340031200/0x3522fbed3b6c33b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee78c41 expref: 2 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384520.862827:0:5772:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89e3441a4000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787384520.862847:0:5772:0:(genops.c:906:class_export_put()) final put ffff89e3441a4000/96efe439-3b25-4671-a225-6795623d17b0 00010000:00010000:2.0:1787384520.862904:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384520.862907:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384520.862908:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787384520.863157:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3441a4000/96efe439-3b25-4671-a225-6795623d17b0 for MGS 00000020:00000080:3.0:1787384520.863209:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e3441a1000 for MGS 00000001:00080000:1.0:1787384520.873756:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000001:00080000:1.0:1787384520.873773:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1787384520.873782:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000001:00080000:1.0:1787384520.873787:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787384520.873791:0:5806:0:(genops.c:906:class_export_put()) final put ffff89e3441a3000/ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:1.0:1787384520.873813:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3441a3000/ddc9253f-47aa-4509-981d-645f91ec7250 for lustre-MDT0000 00000020:00000080:1.0:1787384520.873903:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e3441a7800 for lustre-MDT0000 00000001:00100000:2.0:1787384520.882678:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:2.0:1787384520.882689:0:7483:0:(genops.c:906:class_export_put()) final put ffff89e3727a9000/ddc9253f-47aa-4509-981d-645f91ec7250 00000020:00000080:3.0:1787384520.882941:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3727a9000/ddc9253f-47aa-4509-981d-645f91ec7250 for lustre-OST0001 00000020:00000080:3.0:1787384520.882993:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e3727ab000 for lustre-OST0001 00000040:00080000:2.0:1787384521.097058:0:11530:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787384521.097077:0:11530:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787384521.097372:0:11530:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1787384521.097390:0:11530:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787384521.289021:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787384521.289048:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195955456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384521.289133:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384521.289213:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195955456 00000100:00100000:3.0:1787384521.289223:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195955456 00000100:00100000:3.0:1787384521.289290:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787384521.289301:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195955456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787384521.289346:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384521.289398:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195955456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384521.289405:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00080000:3.0:1787384521.289427:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384521.289469:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195955456:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384521.739602:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384521.804176:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195955968:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.804247:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.804309:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787384521.804316:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e377b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195955584:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.804347:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.804370:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195956096:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.804495:0:7691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195955968 00000100:00100000:1.0:1787384521.804505:0:7691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195955968 00000100:00100000:1.0:1787384521.804559:0:7691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787384521.804568:0:7691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e34306ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195955968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.804634:0:7691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e34306ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195955968:12345-0@lo:400:kworker.0 Request processed in 67us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.804641:0:7691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1787384521.804664:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384521.804782:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.804826:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195955968:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.804851:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195955712:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.805114:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.805139:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384521.805145:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195955840:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.805167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384521.805199:0:5778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195955584 00000100:00100000:2.0:1787384521.805204:0:5778:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195955584 00000100:00100000:2.0:1787384521.805235:0:5778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787384521.805242:0:5778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195955584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.805280:0:5778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195955584:12345-0@lo:400:kworker.0 Request processed in 39us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384521.805287:0:5778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1787384521.805316:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195955712 00000100:00100000:2.0:1787384521.805319:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195955712 00000100:00100000:2.0:1787384521.805341:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195955840 00000100:00100000:2.0:1787384521.805344:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195955840 00000100:00100000:2.0:1787384521.805367:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787384521.805372:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195955712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.810850:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343068000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195955712:12345-0@lo:400:kworker.0 Request processed in 5473us (5732us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384521.810884:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1787384521.810930:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1787384521.810943:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195955840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.810986:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195955840:12345-0@lo:400:kworker.0 Request processed in 48us (5817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384521.810993:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00080000:2.0:1787384521.811042:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384521.811170:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195955840:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.811182:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195955712:0@lo:400:kworker.0 00000100:00100000:2.0:1787384521.811232:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e377b4d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195955584:0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.811322:0:6574:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195956096 00000100:00100000:1.0:1787384521.811330:0:6574:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195956096 00000100:00100000:1.0:1787384521.811408:0:6574:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787384521.811419:0:6574:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195956096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384521.811473:0:6574:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343068380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195956096:12345-0@lo:400:kworker.0 Request processed in 56us (6690us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384521.811492:0:6574:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1787384521.816355:0:5779:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787384521.816431:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195956096:0@lo:400:kworker.0 00000100:00100000:2.0:1787384522.324517:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195956224:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384522.324592:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384522.326228:0:6577:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195956224 00000100:00100000:0.0:1787384522.326243:0:6577:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195956224 00000100:00100000:0.0:1787384522.326307:0:6577:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787384522.326317:0:6577:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195956224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384522.326350:0:6577:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384522.340410:0:6577:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195956224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14085us (15808us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.340435:0:6577:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787384522.345687:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195956224:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787384522.761463:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787384522.824845:0:12824:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787384522.846492:0:12824:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1787384522.846553:0:12824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.846570:0:12824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.846578:0:12824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.846598:0:12824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384522.846616:0:12824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787384522.846622:0:12824:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787384522.846647:0:12824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384522.846651:0:12824:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787384522.846657:0:12824:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787384522.846680:0:12824:0:(import.c:65:import_set_state_nolock()) ffff89e37c666800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787384522.847158:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874208195956352:0@lo:39:umount.0 00000100:00100000:2.0:1787384522.847238:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384522.847431:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195956352 00000100:00100000:0.0:1787384522.847440:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195956352 00000100:00100000:0.0:1787384522.847497:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1787384522.847508:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874208195956352:12345-0@lo:39:umount.0 00000020:00000080:0.0:1787384522.848222:0:5784:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3126 00000100:00080000:0.0:1787384522.848232:0:5784:0:(import.c:65:import_set_state_nolock()) ffff89e37c661800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1787384522.848315:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3303:x1874208195956352:12345-0@lo:39:umount.0 Request processed in 809us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384522.848507:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:0.0:1787384522.848644:0:5784:0:(genops.c:906:class_export_put()) final put ffff89e34785a000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:2.0:1787384522.850909:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384522.850923:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.850953:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3429d5400 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:2.0:1787384522.850957:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.850967:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384522.850974:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384522.850979:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384522.850982:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787384522.850985:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787384522.851023:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.851030:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384522.851067:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.851075:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3429d5400/0x3522fbed3b6c33a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c33aa expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.851090:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384522.851092:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384522.851094:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787384522.851104:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e34785a000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787384522.851153:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e37c661800 for lustre-MDT0000 00000100:00100000:2.0:1787384522.851163:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384522.851187:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e343068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195956480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384522.851253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384522.851301:0:5770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195956480 00000100:00100000:2.0:1787384522.851308:0:5770:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195956480 00010000:00010000:3.0:1787384522.851703:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384522.853312:0:5770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787384522.853329:0:5770:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3304:x1874208195956480:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384522.853683:0:5770:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384522.853704:0:5770:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e366121a00/0x3522fbed3b6c33aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c33a3 expref: 19 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.853721:0:5770:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384522.853960:0:5770:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441d8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3304:x1874208195956480:12345-0@lo:103:ldlm_bl.0 Request processed in 636us (2705us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384522.853968:0:5770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1787384522.854061:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e37c666800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1787384522.854163:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e343068e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195956480:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384522.854207:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874208195956352:0@lo:39:umount.0 00000100:00080000:0.0:1787384522.860693:0:12824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384522.860701:0:12824:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787384522.860709:0:12824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787384522.867321:0:12824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867356:0:12824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867363:0:12824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867371:0:12824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867415:0:12824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384522.867424:0:12824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867430:0:12824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867434:0:12824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867440:0:12824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867454:0:12824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1787384522.867461:0:12824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867467:0:12824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867473:0:12824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867479:0:12824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867612:0:12824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1787384522.867619:0:12824:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867632:0:12824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867637:0:12824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384522.867642:0:12824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868059:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1787384522.868068:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868075:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031800 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384522.868078:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868098:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384522.868105:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384522.868110:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787384522.868112:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1787384522.868148:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868154:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384522.868179:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868185:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340031800/0x3522fbed3b6c33b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c33bf expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868201:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787384522.868204:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868209:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031a00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384522.868211:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868217:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384522.868222:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384522.868233:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1787384522.868235:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1787384522.868237:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1787384522.868251:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868256:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384522.868262:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868267:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c32d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c32d8 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868279:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384522.868282:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868288:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120e00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384522.868291:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868297:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384522.868304:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384522.868309:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1787384522.868312:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1787384522.868313:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1787384522.868345:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868352:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384522.868370:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868377:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e366120e00/0x3522fbed3b6c35d3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c35da expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868387:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384522.868390:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868395:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3429d5600 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384522.868398:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868402:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384522.868408:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384522.868413:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1787384522.868414:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 00010000:00010000:3.0:1787384522.868424:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868429:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787384522.868434:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.868449:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384522.868451:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384522.868453:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384522.868475:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195956608:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384522.868725:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384522.868850:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384522.868880:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195956736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384522.868906:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384522.868942:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195956608 00000100:00100000:3.0:1787384522.868949:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195956608 00000100:00100000:3.0:1787384522.868990:0:7472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195956736 00000100:00100000:3.0:1787384522.868994:0:7472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195956736 00000100:00100000:3.0:1787384522.869018:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787384522.869027:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+19:3306:x1874208195956608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384522.869039:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384522.869063:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c33bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c33b8 expref: 19 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.869077:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384522.869110:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+18:3306:x1874208195956608:12345-0@lo:103:ldlm_bl.0 Request processed in 85us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384522.869117:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787384522.869134:0:7472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787384522.869140:0:7472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:3306:x1874208195956736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384522.869148:0:7472:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384522.869156:0:7472:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108ae00/0x3522fbed3b6c32d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c32d1 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.869176:0:7472:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384522.869198:0:7472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3306:x1874208195956736:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384522.869205:0:7472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787384522.869236:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195956864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384522.869262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384522.869280:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384522.869286:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195956992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384522.869306:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384522.869327:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195956864 00000100:00100000:3.0:1787384522.869331:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195956864 00000100:00100000:3.0:1787384522.869991:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195956992 00000100:00100000:3.0:1787384522.869996:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195956992 00000100:00100000:3.0:1787384522.870016:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787384522.870022:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373139180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+17:3304:x1874208195956864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384522.870031:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384522.870042:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e366120a00/0x3522fbed3b6c35da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c35d3 expref: 17 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.870064:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384522.870103:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373139180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+16:3304:x1874208195956864:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (840us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384522.870110:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787384522.870125:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384522.870131:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+15:3304:x1874208195956992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384522.870138:0:5769:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384522.870156:0:5769:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3413fca00/0x3522fbed3b6c308c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c3085 expref: 15 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.870168:0:5769:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384522.870190:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372f1f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:3304:x1874208195956992:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (883us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384522.870195:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787384522.870238:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195956992:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384522.870247:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195956864:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384522.870282:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195956736:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384522.870294:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195956608:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384522.871163:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384522.871306:0:12824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787384522.871315:0:12824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3429d5600/0x3522fbed3b6c3085 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c308c expref: -99 pid: 5763 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384522.871420:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787384522.871444:0:12824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 10000000:01000000:2.0:1787384522.871450:0:12824:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:2.0:1787384522.871453:0:12824:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1787384522.871604:0:12824:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1787384522.871608:0:12824:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1787384522.871613:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384522.871619:0:12824:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:3.0:1787384522.871626:0:12824:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89e377d88000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787384522.871633:0:12824:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff89e377dd4800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787384522.871640:0:12824:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff89e37293e800 5b85b8ac-6b36-499b-99d6-8bdc07d5605c 192.168.203.51@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1787384522.871646:0:12824:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff89e351efb380) has exports, disconnecting them 00000020:00080000:3.0:1787384522.871650:0:12824:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89e377d88000), last request at 1787384521 00000020:00000080:3.0:1787384522.871659:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3299 00000100:00080000:3.0:1787384522.871679:0:12824:0:(import.c:65:import_set_state_nolock()) ffff89e377d8e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787384522.871734:0:12824:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e377d88000): rc 0 00000020:00000080:3.0:1787384522.871737:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e377d88000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1787384522.871757:0:12824:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff89e377dd4800), last request at 1787384521 00000020:00000080:1.0:1787384522.871918:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e377d88000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1787384522.871965:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e377d8e800 for lustre-MDT0000 00000020:00000080:3.0:1787384522.872094:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c31c0 00000100:00080000:3.0:1787384522.872100:0:12824:0:(import.c:65:import_set_state_nolock()) ffff89e377902000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1787384522.872111:0:12824:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e377dd4800): rc 0 00000020:00000080:3.0:1787384522.872113:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e377dd4800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1787384522.872121:0:12824:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb1ec8181bae0 00000100:00080000:3.0:1787384522.872141:0:12824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787384522.872144:0:12824:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1787384522.872156:0:12824:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1787384522.872225:0:12824:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1787384522.872250:0:12824:0:(import.c:65:import_set_state_nolock()) ffff89e377b35800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1787384522.872264:0:12824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787384522.872267:0:12824:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1787384522.872275:0:12824:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:1.0:1787384522.872474:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787384522.872481:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e377dd4800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1787384522.872504:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e377902000 for lustre-MDT0000 00000100:00080000:3.0:1787384522.873890:0:12824:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1787384522.873917:0:12824:0:(import.c:65:import_set_state_nolock()) ffff89e349e42000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1787384522.873953:0:12824:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff89e351efb380) has no exports 00000100:00100000:2.0:1787384522.874407:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195957120:0@lo:9:umount.0 00000100:00100000:2.0:1787384522.874474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384522.874505:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195957248:0@lo:9:umount.0 00000100:00100000:2.0:1787384522.874540:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384522.875451:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384522.875513:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195957120 00000100:00100000:2.0:1787384522.875522:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195957120 00000100:00100000:2.0:1787384522.875591:0:10631:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195957248 00000100:00100000:2.0:1787384522.875595:0:10631:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195957248 00000100:00100000:2.0:1787384522.875621:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787384522.875630:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e343068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874208195957120:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787384522.875657:0:10631:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c320d 00000100:00080000:2.0:1787384522.875667:0:10631:0:(import.c:65:import_set_state_nolock()) ffff89e377d8a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787384522.875716:0:10631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787384522.876232:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e343068e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3303:x1874208195957120:12345-0@lo:9:umount.0 Request processed in 600us (1755us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384522.876240:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787384522.876258:0:10631:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787384522.876265:0:10631:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1874208195957248:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787384522.876278:0:10631:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3309 00000100:00080000:2.0:1787384522.876284:0:10631:0:(import.c:65:import_set_state_nolock()) ffff89e37b8f6800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787384522.876306:0:10631:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787384522.876517:0:10631:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377b4d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3303:x1874208195957248:12345-0@lo:9:umount.0 Request processed in 252us (1975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384522.876524:0:10631:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00010000:2.0:1787384522.876554:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384522.876969:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787384522.877164:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e377b35800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00010000:00010000:0.0:1787384522.877243:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787384522.877277:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787384522.878317:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787384522.878326:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195957120:0@lo:9:umount.0 00000100:00080000:2.0:1787384522.878368:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e349e42000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1787384522.878379:0:3303:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1787384522.878381:0:3303:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787384522.878384:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195957248:0@lo:9:umount.0 00000020:00080000:3.0:1787384522.890453:0:12824:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff89e351efb380) has no exports 00000020:00000080:3.0:1787384522.961834:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c30e0 00000020:00000080:3.0:1787384522.961850:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e347b1a800/lustre-QMT0000_UUID 00000020:01000000:3.0:1787384522.962221:0:12824:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:3.0:1787384522.963149:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384522.963162:0:12824:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787384522.963167:0:12824:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff89e3741a19c0) has no exports 00000020:00000080:2.0:1787384522.964513:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e347b1a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:3.0:1787384522.965121:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c30d9 00000020:00000080:3.0:1787384522.965132:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e372773000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787384522.965222:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e372773000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1787384522.965282:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384522.965294:0:12824:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1787384522.965298:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e37419d000/lustre-QMT0000_UUID 00000020:00000080:2.0:1787384522.965300:0:12824:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37419d000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1787384522.965305:0:12824:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1787384523.785454:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787384524.418213:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787384524.418223:0:6600:0:(genops.c:906:class_export_put()) final put ffff89e377d8f000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787384524.418329:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e377d8f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1787384524.418375:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e377d8a000 for lustre-OST0000 00010000:00010000:2.0:1787384524.810389:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384525.833075:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787384525.966276:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787384525.968097:0:7483:0:(genops.c:906:class_export_put()) final put ffff89e37b8f1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787384525.968240:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37b8f1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787384525.968347:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e37b8f6800 for lustre-OST0001 00000001:00100000:2.0:1787384525.982463:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5b85b8ac-6b36-499b-99d6-8bdc07d5605c 00000001:00080000:2.0:1787384525.982477:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1787384525.982483:0:5806:0:(genops.c:906:class_export_put()) final put ffff89e37293e800/5b85b8ac-6b36-499b-99d6-8bdc07d5605c 00000020:00000080:0.0:1787384525.983164:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37293e800/5b85b8ac-6b36-499b-99d6-8bdc07d5605c for lustre-MDT0000 00000020:00000080:0.0:1787384525.983224:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e37293a800 for lustre-MDT0000 00010000:00010000:0.0:1787384526.857788:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384526.921364:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195957376:0@lo:400:kworker.0 00000100:00100000:0.0:1787384526.921440:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384526.921509:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384526.921516:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195957504:0@lo:400:kworker.0 00000100:00100000:0.0:1787384526.921543:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384526.921762:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195957376 00000100:00100000:3.0:1787384526.921771:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195957376 00000100:00100000:3.0:1787384526.921835:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 311 00000100:00100000:3.0:1787384526.921845:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:3306:x1874208195957376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384526.921920:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351e3c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9+14:3306:x1874208195957376:12345-0@lo:400:kworker.0 Request processed in 76us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384526.921927:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 311 00000100:00100000:2.0:1787384526.922195:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195957632:0@lo:400:kworker.0 00000100:00100000:2.0:1787384526.922229:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384526.922273:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195957504 00000100:00100000:2.0:1787384526.922277:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195957504 00000100:00100000:2.0:1787384526.922298:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195957632 00000100:00100000:2.0:1787384526.922300:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195957632 00000100:00100000:2.0:1787384526.922314:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787384526.922318:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1874208195957504:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787384526.922324:0:5785:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787384526.922351:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3306:x1874208195957504:12345-0@lo:400:kworker.0 Request processed in 31us (806us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787384526.922357:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1787384526.922371:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1787384526.922374:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874208195957632:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1787384526.922379:0:5785:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1787384526.922402:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3304:x1874208195957632:12345-0@lo:400:kworker.0 Request processed in 26us (172us total) trans 0 rc -107/-107 00000100:00100000:2.0:1787384526.922407:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:2.0:1787384526.922442:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787384526.922447:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89e377d8a800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1787384526.922451:0:3304:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787384526.923307:0:3306:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1787384526.923311:0:3306:0:(import.c:65:import_set_state_nolock()) ffff89e377dd6000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1787384526.923315:0:3306:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1787384526.923319:0:3306:0:(import.c:65:import_set_state_nolock()) ffff89e377dd6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384526.923322:0:3306:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 165 00000100:00080000:0.0:1787384526.923329:0:3306:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e377dd6000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1787384526.923359:0:3306:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e373361f80 x1874208195957760/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384526.923381:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195957504:0@lo:400:kworker.0 00000100:00100000:0.0:1787384526.923406:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3306:1874208195957376:0@lo:400:kworker.0 00000100:00100000:0.0:1787384526.923448:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874208195957760:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1787384526.923732:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384526.923772:0:5785:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195957760 00000100:00100000:0.0:1787384526.923777:0:5785:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195957760 00000100:00100000:0.0:1787384526.923804:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1787384526.923810:0:5785:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37314b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874208195957760:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:0.0:1787384526.925306:0:5785:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787384526.965196:0:5785:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37314b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874208195957760:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 41376us (41455us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787384526.965210:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:1.0:1787384526.965352:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e377dd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384526.965358:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787384526.965362:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373361f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874208195957760:0@lo:38:ptlrpcd_00_02.0 00000100:00080000:2.0:1787384526.980285:0:3304:0:(import.c:65:import_set_state_nolock()) ffff89e377d8a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384526.980303:0:3304:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 185 00000100:00080000:2.0:1787384526.980315:0:3304:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e377d8a800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1787384526.980357:0:3304:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e241333480 x1874208195957888/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384526.980467:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874208195957888:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1787384526.980539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384526.980691:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3304:1874208195957632:0@lo:400:kworker.0 00000100:00100000:0.0:1787384526.981605:0:5784:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195957888 00000100:00100000:0.0:1787384526.981616:0:5784:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195957888 00000100:00100000:0.0:1787384526.981671:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1787384526.981679:0:5784:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874208195957888:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1787384526.981697:0:5784:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1787384526.989359:0:5784:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874208195957888:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 7669us (8809us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787384526.989375:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:1.0:1787384526.990906:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e377d8a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384526.990918:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1787384526.990925:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874208195957888:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:3.0:1787384527.887265:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384528.907273:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787384529.034615:0:12824:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89e3462706c0 - data ffff89e36d836a20/ffff89e377d93400 00000020:01000000:2.0:1787384529.034770:0:12824:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89e351164ea0 - data ffff89e36d83cd80/ffff89e347aaf400 00000001:00000004:2.0:1787384529.044750:0:12824:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1787384529.200565:0:12824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1787384529.200574:0:12824:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1787384529.200596:0:12824:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787384529.200599:0:12824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787384529.200887:0:6653:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787384529.200893:0:6653:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787384529.200902:0:6653:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1787384529.201714:0:12824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1787384529.201719:0:12824:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:3.0:1787384529.201747:0:12824:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1787384529.201749:0:12824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787384529.202618:0:7837:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787384529.202623:0:7837:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:1.0:1787384529.202633:0:7837:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:1.0:1787384529.305647:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c30a8 00000020:00000080:1.0:1787384529.305662:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e37c5d9800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787384529.305715:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37c5d9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787384529.307641:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c30bd 00000020:00000080:0.0:1787384529.307656:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e37c5df000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1787384529.307704:0:12824:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1787384529.307710:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384529.307719:0:12824:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787384529.307723:0:12824:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff89e351ef99c0) has no exports 00000004:01000000:0.0:1787384529.307955:0:12824:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1787384529.307972:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c32fb 00000020:00000080:0.0:1787384529.307977:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e379ff0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787384529.308055:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37c5df000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787384529.308117:0:12824:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787384529.308121:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384529.308127:0:12824:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787384529.308130:0:12824:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff89e37b273380) has no exports 00000020:00000080:0.0:1787384529.308136:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c32f4 00000020:00000080:0.0:1787384529.308140:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e349e45800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787384529.308158:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e379ff0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:0.0:1787384529.308551:0:12824:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787384529.308556:0:12824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1787384529.308559:0:12824:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1787384529.308565:0:12824:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787384529.308568:0:12824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787384529.308646:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e349e45800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787384529.308727:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384529.308735:0:12824:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384529.308740:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3206 00000020:00000080:0.0:1787384529.308744:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e346078000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787384529.308763:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e349e42000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1787384529.308768:0:37:0:(genops.c:906:class_export_put()) final put ffff89e379ff7800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787384529.308770:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e379ff7800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1787384529.308775:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787384529.309001:0:12824:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1787384529.309014:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384529.309019:0:12824:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787384529.309022:0:12824:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff89e351f60000) has no exports 00000020:00000080:0.0:1787384529.309028:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c31ff 00000020:00000080:0.0:1787384529.309032:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e377b30000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787384529.309049:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e346078000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:0.0:1787384529.309440:0:12824:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1787384529.309443:0:12824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1787384529.309446:0:12824:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1787384529.309449:0:12824:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787384529.309451:0:12824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787384529.309479:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e377b30000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787384529.309562:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384529.309569:0:12824:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384529.309599:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384529.309602:0:12824:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384529.309615:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e381d40000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1787384529.309618:0:12824:0:(genops.c:865:class_export_destroy()) destroying export ffff89e381d40000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1787384529.309626:0:12824:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787384529.309761:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c30c4 00000020:00000080:0.0:1787384529.309766:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e37c5da000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787384529.309846:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e377b35800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1787384529.309851:0:37:0:(genops.c:906:class_export_put()) final put ffff89e377b33800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787384529.309945:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e377b33800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1787384529.309954:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787384529.310094:0:12824:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1787384529.310099:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384529.310104:0:12824:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787384529.310108:0:12824:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff89e351efcd40) has no exports 00000020:00000080:0.0:1787384529.310128:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384529.310131:0:12824:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1787384529.310134:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c30cb 00000020:00000080:0.0:1787384529.310138:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e37c5df800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787384529.310156:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37c5da000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1787384529.310159:0:37:0:(genops.c:906:class_export_put()) final put ffff89e37c5dd000/lustre-MDD0000_UUID 00000020:00000080:3.0:1787384529.310162:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37c5dd000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1787384529.310165:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1787384529.310357:0:12824:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e348611800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1787384529.310361:0:12824:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e348611800 3 00000020:01000004:0.0:1787384529.310364:0:12824:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e348611800 from lustre-MDT0000 00000020:00000080:0.0:1787384529.310381:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384529.310385:0:12824:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1787384529.310388:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e37c5de800/lustre-MDT0000_UUID 00000020:00000080:0.0:1787384529.310390:0:12824:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37c5de800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1787384529.310396:0:12824:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1787384529.310422:0:12824:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1787384529.310425:0:12824:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1787384529.310428:0:12824:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1787384529.310430:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384529.310433:0:12824:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787384529.310439:0:12824:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff89e3450f4000 0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384529.310444:0:12824:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff89e351f619c0) has exports, disconnecting them 00000020:00080000:0.0:1787384529.310448:0:12824:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff89e3450f4000), last request at 1787384287 00000020:00000080:0.0:1787384529.310460:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3069 00000020:00010000:0.0:1787384529.310464:0:12824:0:(genops.c:1942:obd_stale_export_put()) Put export ffff89e3450f4000: total 1 00000100:00080000:0.0:1787384529.310473:0:12824:0:(import.c:65:import_set_state_nolock()) ffff89e3450f1000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787384529.310494:0:12824:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e3450f4000): rc 0 00000020:00080000:0.0:1787384529.310499:0:12824:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff89e351f619c0) has no exports 00000020:00010000:1.0:1787384529.310606:0:5771:0:(genops.c:1928:obd_stale_export_get()) Get export ffff89e3450f4000: total 1 00010000:00010000:1.0:1787384529.310648:0:5771:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff89e3450f4000, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1787384529.310688:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624c400/0x3522fbed3b6c3380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c3379 expref: 9 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384529.310704:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e366120800/0x3522fbed3b6c35be lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c35b7 expref: 8 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384529.310713:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3429d4e00/0x3522fbed3b6c338e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c3387 expref: 7 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384529.310722:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e366120000/0x3522fbed3b6c33cd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c33c6 expref: 6 pid: 5777 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384529.310730:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e341677200/0x3522fbed3b6c3173 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c316c expref: 5 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384529.310743:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e366121600/0x3522fbed3b6c35cc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c35c5 expref: 4 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384529.310755:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3429d4600/0x3522fbed3b6c339c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c3395 expref: 3 pid: 5778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384529.310763:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624de00/0x3522fbed3b6c336b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x3522fbed3b6c3364 expref: 2 pid: 5776 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384529.310772:0:5771:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff89e3450f4000, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1787384529.310783:0:5771:0:(genops.c:906:class_export_put()) final put ffff89e3450f4000/0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9 00000100:00100000:0.0:1787384529.310825:0:5778:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff89e351e12e00:5778] 2 exiting: rc = 0 00000020:00000080:3.0:1787384529.311155:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37c5df800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:3.0:1787384529.311181:0:5777:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff89e351e12600:5777] 1 exiting: rc = 0 00010000:00010000:1.0:1787384529.311298:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384529.311301:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384529.311303:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787384529.311330:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3450f4000/0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9 for MGS 00000020:00000080:3.0:1787384529.311361:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e3450f1000 for MGS 00000100:00100000:2.0:1787384529.311908:0:5776:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff89e351e12000:5776] 0 exiting: rc = 1 00000100:00100000:0.0:1787384529.312183:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312192:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312197:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312202:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312208:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312215:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312220:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312226:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312231:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312241:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312247:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312253:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312258:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312264:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312269:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312274:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312279:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312284:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312290:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312295:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312301:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312308:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312314:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312321:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312326:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312331:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312336:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312545:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312555:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312561:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312578:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312584:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312591:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312596:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312601:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312606:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312611:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312615:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312620:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312625:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312630:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312634:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312639:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312645:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312650:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312655:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312661:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312666:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312672:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312678:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312684:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312689:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312694:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312699:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312705:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312710:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312716:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312721:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312728:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312733:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312738:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312743:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312748:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.312753:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1787384529.313441:0:12824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787384529.313451:0:12824:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1787384529.314327:0:12824:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89e3431fc180 - data ffff89e36d860438/ffff89e377d93c00 00000020:01000000:0.0:1787384529.314439:0:12824:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89e347d945a0 - data ffff89e36d856af8/ffff89e351ca5000 00000020:00000080:0.0:1787384529.315320:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c304d 00000020:00000080:0.0:1787384529.315327:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e3450f1800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1787384529.315374:0:12824:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e348611800 from MGS, refs=2 00000020:01000004:0.0:1787384529.315377:0:12824:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e348611800 2 00000020:01000004:0.0:1787384529.315380:0:12824:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e348611800 from MGS 00000020:00000080:0.0:1787384529.315400:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384529.315406:0:12824:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1787384529.315409:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e3450f2000/MGS 00000020:00000080:0.0:1787384529.315411:0:12824:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3450f2000/MGS for MGS 00000020:01000000:0.0:1787384529.315417:0:12824:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1787384529.315489:0:12824:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1787384529.315494:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384529.315499:0:12824:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787384529.315506:0:12824:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff89e37c662800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787384529.315511:0:12824:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff89e351f63380) has exports, disconnecting them 00000020:00080000:0.0:1787384529.315516:0:12824:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff89e37c662800), last request at 1787384288 00000020:00000080:0.0:1787384529.315520:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3118 00000020:00080000:0.0:1787384529.315531:0:12824:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e37c662800): rc 0 00000020:00000080:0.0:1787384529.315547:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e37c662800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787384529.315625:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3450f1800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787384529.316633:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37c662800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1787384529.316986:0:12824:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1787384529.316991:0:12824:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787384529.316995:0:12824:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787384529.317000:0:12824:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1787384529.317192:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384529.317200:0:12824:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:1.0:1787384529.317205:0:12824:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e348611800 1 00000020:00000080:3.0:1787384529.317206:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e37c666800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787384529.317211:0:12824:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c303f 00000020:00000080:3.0:1787384529.317214:0:36:0:(genops.c:906:class_export_put()) final put ffff89e37c664000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1787384529.317216:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37c664000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1787384529.317216:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e3450f7800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1787384529.317221:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:1.0:1787384529.317224:0:12824:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:1.0:1787384529.317228:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384529.317232:0:12824:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787384529.317235:0:12824:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff89e351313380) has no exports 00000020:00000080:3.0:1787384529.317274:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3450f7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1787384529.360394:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384529.360411:0:12824:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1787384529.360417:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e3450a0800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1787384529.360421:0:12824:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3450a0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1787384529.360428:0:12824:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1787384529.360545:0:12824:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e357c5b000 00000020:01000000:3.0:1787384529.360566:0:12824:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1787384529.360570:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384529.360575:0:12824:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787384529.360579:0:12824:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff89e351314d40) has no exports 00000100:00100000:1.0:1787384529.361168:0:7691:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff89e37b8dd200:7691] 3 exiting: rc = 0 00000100:00100000:2.0:1787384529.361344:0:5783:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff89e345644e00:5783] 0 exiting: rc = 1 00000100:00100000:1.0:1787384529.361943:0:5784:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff89e344207800:5784] 1 exiting: rc = 0 00000100:00100000:1.0:1787384529.362001:0:5785:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff89e345645800:5785] 2 exiting: rc = 0 00000100:00100000:3.0:1787384529.362164:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362172:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362176:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362182:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362199:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362204:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362209:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362214:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362218:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362223:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362228:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362233:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362237:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362242:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362247:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362252:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362257:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362261:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362266:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362271:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362276:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362286:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362292:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362298:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362303:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362309:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362314:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362320:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362326:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362331:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362341:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362348:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362356:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362361:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362366:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362373:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362378:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362383:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362387:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362398:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362402:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362407:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362413:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362417:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362422:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362427:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362432:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362437:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362455:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362460:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362474:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362480:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362485:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362489:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362494:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362499:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362506:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362512:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362517:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362521:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362526:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362532:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362542:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.362547:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.369509:0:5787:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff89e344275a00:5787] 1 exiting: rc = 0 00000100:00100000:2.0:1787384529.370105:0:5786:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff89e347acdc00:5786] 0 exiting: rc = 1 00000100:00100000:3.0:1787384529.370196:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370207:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370215:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370220:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370231:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370237:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370243:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370248:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370254:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370269:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370275:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370280:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370286:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370290:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370295:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370300:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370305:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370310:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370315:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370321:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370326:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370331:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370337:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370372:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370378:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370383:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370389:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370393:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370398:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370403:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370407:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370411:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370415:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370420:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370424:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370428:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370433:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370437:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370441:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370446:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370450:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370455:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370459:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370524:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370653:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370659:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370664:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370669:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370674:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370678:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370683:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370687:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370691:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370696:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370700:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370704:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370709:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370713:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370718:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370721:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370725:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370729:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370734:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.370738:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.371301:0:5789:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff89e344207c00:5789] 1 exiting: rc = 0 00000100:00100000:0.0:1787384529.371390:0:5788:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff89e344275000:5788] 0 exiting: rc = 1 00000100:00100000:3.0:1787384529.371429:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371437:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371444:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371450:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371457:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371462:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371661:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371670:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371676:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371682:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371688:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371694:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371715:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371722:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371727:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371741:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371746:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371752:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371757:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371762:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371767:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371773:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371778:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371784:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371803:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371809:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371815:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371821:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371826:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371831:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371837:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371843:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371850:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371856:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371956:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371964:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371983:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371990:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.371996:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372001:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372088:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372095:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372101:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372107:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372114:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372120:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372127:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372133:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372139:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372161:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372173:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372179:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372185:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372192:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372197:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372202:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372209:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372217:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372223:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372230:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372237:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372243:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372248:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384529.372261:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.381938:0:5791:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff89e344228800:5791] 1 exiting: rc = 0 00000100:00100000:1.0:1787384529.382325:0:5790:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff89e344228c00:5790] 0 exiting: rc = 1 00000100:00100000:2.0:1787384529.382426:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382433:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382438:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382444:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382449:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382454:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382459:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382464:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382470:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382476:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382481:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382485:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382490:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382495:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382500:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382520:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382526:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382531:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382537:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382542:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382547:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382553:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382557:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382562:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382567:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382572:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382576:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382581:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382586:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382590:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382595:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382601:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382605:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382611:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382616:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382621:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382627:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382632:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382637:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382643:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382648:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382653:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382658:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382663:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382668:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382673:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382678:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382683:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382688:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382692:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382704:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382709:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382714:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382719:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382724:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382729:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382734:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382738:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382743:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382748:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382753:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382758:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382763:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.382769:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.383440:0:5793:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff89e344229400:5793] 1 exiting: rc = 0 00000100:00100000:3.0:1787384529.383587:0:5792:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff89e344229a00:5792] 0 exiting: rc = 1 00000100:00100000:2.0:1787384529.383688:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383695:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383700:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383705:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383709:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383714:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383719:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383724:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383730:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383735:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383741:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383746:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383751:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383756:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383760:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383765:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383770:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383775:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383780:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383785:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383790:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383806:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383811:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383816:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383822:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383827:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383832:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383837:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383842:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383847:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.383853:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384286:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384295:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384299:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384304:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384308:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384313:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384318:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384323:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384327:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384332:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384337:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384343:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384348:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384353:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384358:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384363:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384368:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384373:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384378:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384382:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384388:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384392:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384396:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384401:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384406:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384421:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384426:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384431:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384436:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384440:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384444:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384449:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384529.384454:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384529.385154:0:5795:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff89e351ee4400:5795] 1 exiting: rc = 0 00000100:00100000:3.0:1787384529.385333:0:5794:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff89e344229c00:5794] 0 exiting: rc = 1 00000100:00100000:1.0:1787384529.385457:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385466:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385471:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385476:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385482:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385486:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385491:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385495:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385500:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385505:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385510:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385515:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385519:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385534:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385539:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385544:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385550:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385554:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385560:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385565:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385570:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385575:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385580:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385584:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385589:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385594:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385599:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385605:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385610:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385615:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385619:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385624:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385629:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385634:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385639:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385644:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385649:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385653:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385661:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385668:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385674:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385680:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385686:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385692:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385698:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385704:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385710:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385716:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385736:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385742:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385748:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385792:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385800:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385806:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385811:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385816:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385822:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385827:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385831:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385835:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385839:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385844:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385849:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.385854:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.386398:0:5797:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff89e344229600:5797] 1 exiting: rc = 0 00000100:00100000:0.0:1787384529.386691:0:5796:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff89e344229e00:5796] 0 exiting: rc = 1 00000100:00100000:3.0:1787384529.387113:0:5798:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff89e344229000:5798] 2 exiting: rc = 0 00000100:00100000:1.0:1787384529.387225:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387233:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387241:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387249:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387257:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387265:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387273:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387280:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387288:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387296:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387303:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387311:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387318:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387327:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387336:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387343:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387350:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387355:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387376:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387382:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387387:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387393:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387410:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387416:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387422:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387428:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387434:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387440:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387446:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387451:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387456:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387462:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387467:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387473:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387479:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387484:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387489:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387493:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387499:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387504:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387508:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387514:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387519:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387524:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387528:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387533:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387555:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387561:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387567:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387572:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387577:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387582:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387587:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387601:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387607:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387613:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387619:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387624:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387629:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387634:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387640:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387645:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387651:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384529.387664:0:12824:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787384529.399376:0:12824:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384529.399390:0:12824:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:1.0:1787384529.399395:0:12824:0:(genops.c:906:class_export_put()) final put ffff89e3450a6800/MDS_uuid 00000020:00000080:1.0:1787384529.399399:0:12824:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3450a6800/MDS_uuid for MDS 00000020:01000000:1.0:1787384529.399406:0:12824:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:1.0:1787384529.399559:0:12824:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:0.0:1787384529.928943:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384530.953048:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384531.983008:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787384532.043344:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787384532.043351:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787384532.043356:0:36:0:(import.c:65:import_set_state_nolock()) ffff89e377dd6000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384532.043364:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 388 00000100:00080000:3.0:1787384532.043370:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787384532.043376:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e377dd6000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1787384532.043397:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37c4e5c00 x1874208195958144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384532.043415:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787384532.043419:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787384532.043420:0:36:0:(import.c:65:import_set_state_nolock()) ffff89e377d8a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384532.043423:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 388 00000100:00080000:3.0:1787384532.043433:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787384532.043436:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e377d8a800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1787384532.043448:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37c4e7100 x1874208195958272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384532.043481:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874208195958144:0@lo:38:kworker.0 00000100:00100000:2.0:1787384532.043603:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384532.043617:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195958016:0@lo:400:kworker.0 00000400:00000100:2.0:1787384532.045134:0:3304:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874208195958016 offset 0 length 224: 4 00000400:00000100:3.0:1787384532.045850:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208195958144 offset 0 length 520: 4 00000100:00100000:3.0:1787384532.045903:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874208195958272:0@lo:38:kworker.0 00000400:00000100:3.0:1787384532.045931:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874208195958272 offset 0 length 520: 4 00000020:01000004:3.0:1787384532.524389:0:12979:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787384532.561213:0:12979:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1787384532.561259:0:12979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384532.561275:0:12979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384532.561282:0:12979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384532.561288:0:12979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384532.561358:0:12979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787384532.561365:0:12979:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787384532.561388:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384532.561398:0:12979:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e37c4e5c00 x1874208195958144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384547 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384532.561417:0:12979:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787384532.561436:0:12979:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787384532.561442:0:12979:0:(import.c:65:import_set_state_nolock()) ffff89e377dd6000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787384532.561446:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384532.561450:0:12979:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e37c4e5c00 x1874208195958144/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384547 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384532.561458:0:12979:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787384532.561461:0:12979:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:0.0:1787384532.563525:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874208195958144:0@lo:38:kworker.0 00010000:00010000:2.0:1787384532.564980:0:12979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384532.565007:0:12979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384532.565015:0:12979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384532.565022:0:12979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384532.568033:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787384532.568049:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384532.568063:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121800 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:1.0:1787384532.568068:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384532.568079:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384532.568086:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384532.568092:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787384532.568095:0:5771:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787384532.568117:0:5771:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787384532.574355:0:12979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384532.574453:0:12979:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384532.574467:0:12979:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384532.574474:0:12979:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384532.574480:0:12979:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384532.574504:0:12979:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787384532.574510:0:12979:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1787384532.574544:0:12979:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1787384532.574549:0:12979:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1787384532.574554:0:12979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384532.574560:0:12979:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787384532.574564:0:12979:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff89e351310000) has no exports 00000020:00080000:3.0:1787384532.574588:0:12979:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff89e351310000) has no exports 00000020:01000000:3.0:1787384532.576183:0:12979:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89e379f71060 - data ffff89e2414af438/ffff89e37b2a7800 00000020:01000000:3.0:1787384532.576334:0:12979:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89e37bc123c0 - data ffff89e36d812af8/ffff89e377ede400 00010000:00010000:2.0:1787384532.576670:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384532.576679:0:5772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384532.576691:0:5772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366121000 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:2.0:1787384532.576707:0:5772:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384532.576718:0:5772:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384532.576725:0:5772:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384532.576730:0:5772:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384532.576733:0:5772:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1787384532.576737:0:5772:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1787384532.576774:0:5772:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384532.576780:0:5772:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787384532.576839:0:8293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384532.576845:0:8293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384532.576852:0:8293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e366120200 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:1.0:1787384532.576855:0:8293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384532.576889:0:8293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787384532.576896:0:8293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384532.576901:0:8293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787384532.576903:0:8293:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787384532.576905:0:8293:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787384532.576921:0:8293:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384532.576926:0:8293:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384532.577191:0:5771:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384532.577208:0:5771:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384532.577227:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384532.577233:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e366121800/0x3522fbed3b6c3387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c338e expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384532.577265:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195958656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384532.577329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384532.577402:0:5768:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195958656 00000100:00100000:0.0:1787384532.577409:0:5768:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195958656 00000100:00100000:0.0:1787384532.577446:0:5768:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787384532.577453:0:5768:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373149f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1874208195958656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1787384532.577459:0:5768:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787384532 with bad export cookie 3828899629541109865 00010000:00010000:2.0:1787384532.582174:0:5772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384532.582192:0:5772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e366121000/0x3522fbed3b6c3395 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c339c expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384532.582354:0:8293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384532.582363:0:8293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e366120200/0x3522fbed3b6c35c5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x3522fbed3b6c35cc expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384532.582376:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384532.582378:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384532.582381:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384532.582401:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195958528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384532.582490:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384532.582538:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384532.582545:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195958400:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384532.582568:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384532.582600:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195958528 00000100:00100000:1.0:1787384532.582607:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195958528 00000100:00100000:1.0:1787384532.582633:0:5769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195958400 00000100:00100000:1.0:1787384532.582635:0:5769:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195958400 00000100:00100000:1.0:1787384532.582650:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384532.582657:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1874208195958528:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787384532.582663:0:5769:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787384532 with bad export cookie 3828899629541109865 00000100:00100000:1.0:1787384532.582707:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1874208195958528:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (217us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787384532.582714:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787384532.582730:0:5769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787384532.582734:0:5769:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3441d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1874208195958400:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787384532.582738:0:5769:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787384532 with bad export cookie 3828899629541109865 00000100:00100000:1.0:1787384532.582760:0:5769:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3441d8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3307:x1874208195958400:12345-0@lo:103:ldlm_bl.0 Request processed in 25us (191us total) trans 0 rc -107/-107 00000100:00100000:1.0:1787384532.582765:0:5769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787384532.582791:0:3307:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787384532.582795:0:3307:0:(import.c:65:import_set_state_nolock()) ffff89e351f82800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1787384532.582798:0:3307:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.151@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:3.0:1787384532.583119:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384532.583130:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384532.583132:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384532.584850:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384532.584856:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384532.584871:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384532.602238:0:5768:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373149f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3304:x1874208195958656:12345-0@lo:103:ldlm_bl.0 Request processed in 24776us (24900us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787384532.602252:0:5768:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1787384532.602322:0:3304:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.151@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1787384532.634662:0:3307:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.151@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1787384532.634667:0:3307:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1787384532.634677:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e37c4e6300 x1874208195958016/t0(0) o400->MGC192.168.203.151@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787384548 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384532.638638:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e373148a80 x1874208195958656/t0(0) o103->MGC192.168.203.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787384548 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384532.638648:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e37315ed80 x1874208195958528/t0(0) o103->MGC192.168.203.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787384548 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384532.638658:0:3307:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e241333100 x1874208195958400/t0(0) o103->MGC192.168.203.151@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787384548 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1787384532.638667:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1787384532.638670:0:3307:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1787384532.638671:0:3307:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787384532.641867:0:3304:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff89e351f82800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1787384532.641908:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195958016:0@lo:400:kworker.0 00000100:00100000:0.0:1787384532.641942:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3304:1874208195958656:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1787384532.642410:0:3307:0:(import.c:65:import_set_state_nolock()) ffff89e351f82800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384532.642417:0:3307:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 148 00000100:00080000:1.0:1787384532.642425:0:3307:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import ffff89e351f82800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1787384532.642478:0:3307:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37315ce00 x1874208195958784/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384532.642530:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195958528:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384532.642544:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3307:1874208195958400:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384532.642714:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3303:1874208195958784:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:0.0:1787384532.642756:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874208195958784 offset 0 length 520: 4 00100000:10000000:3.0:1787384532.647895:0:12979:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787384532.684569:0:12979:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c318f 00000020:00000080:2.0:1787384532.684578:0:12979:0:(genops.c:906:class_export_put()) final put ffff89e377906800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787384532.684601:0:12979:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e3450ec800 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787384532.684604:0:12979:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e3450ec800 2 00000020:00000080:0.0:1787384532.684734:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e377906800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000004:2.0:1787384532.684959:0:12979:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e3450ec800 from lustre-OST0000 00000020:00000080:2.0:1787384532.684993:0:12979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384532.685005:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787384532.685015:0:12979:0:(genops.c:906:class_export_put()) final put ffff89e377907800/lustre-OST0000_UUID 00000020:00000080:2.0:1787384532.685018:0:12979:0:(genops.c:865:class_export_destroy()) destroying export ffff89e377907800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787384532.685028:0:12979:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787384532.685076:0:12979:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787384532.685081:0:12979:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787384532.685084:0:12979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384532.685089:0:12979:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787384532.685095:0:12979:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff89e377dd0800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384532.685100:0:12979:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff89e3513119c0) has exports, disconnecting them 00000020:00080000:2.0:1787384532.685105:0:12979:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff89e377dd0800), last request at 1787384304 00000020:00000080:2.0:1787384532.685109:0:12979:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c31b9 00000020:00080000:2.0:1787384532.685120:0:12979:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e377dd0800): rc 0 00000020:00000080:2.0:1787384532.685125:0:12979:0:(genops.c:906:class_export_put()) final put ffff89e377dd0800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1787384532.688019:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e377dd0800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787384532.688057:0:12979:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787384532.688062:0:12979:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384532.688067:0:12979:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787384532.688072:0:12979:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787384532.688124:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e377dd6000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787384532.688267:0:12979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787384532.688275:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1787384532.688280:0:12979:0:(genops.c:906:class_export_put()) final put ffff89e377dd2000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1787384532.688284:0:12979:0:(genops.c:865:class_export_destroy()) destroying export ffff89e377dd2000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1787384532.688293:0:12979:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787384532.688348:0:12979:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e3450ec800 1 00000020:00000080:3.0:1787384532.688354:0:12979:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3149 00000020:00000080:3.0:1787384532.688361:0:12979:0:(genops.c:906:class_export_put()) final put ffff89e37c5d8000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787384532.688377:0:12979:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787384532.688382:0:12979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384532.688387:0:12979:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787384532.688390:0:12979:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff89e351f64d40) has no exports 00000020:00000080:0.0:1787384532.688487:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37c5d8000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1787384532.721542:0:12979:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384532.721557:0:12979:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:0.0:1787384532.721564:0:12979:0:(genops.c:906:class_export_put()) final put ffff89e3450ee000/lustre-OST0000-osd_UUID 00000020:00000080:0.0:1787384532.721568:0:12979:0:(genops.c:865:class_export_destroy()) destroying export ffff89e3450ee000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:0.0:1787384532.721579:0:12979:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:0.0:1787384532.721754:0:12979:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e3450ed800 00000020:02000400:0.0:1787384532.721818:0:12979:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787384533.002335:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384534.026469:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384535.050315:0:5772:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787384535.550709:0:13128:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787384535.568213:0:13128:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1787384535.568285:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.568300:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.568308:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.568331:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.568351:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787384535.568356:0:13128:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787384535.568379:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384535.568389:0:13128:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e37c4e7100 x1874208195958272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384547 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384535.568410:0:13128:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787384535.568416:0:13128:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787384535.568422:0:13128:0:(import.c:65:import_set_state_nolock()) ffff89e377d8a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1787384535.568426:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787384535.568430:0:13128:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e37c4e7100 x1874208195958272/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1787384547 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384535.568436:0:13128:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1787384535.568439:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00010000:00010000:2.0:1787384535.568521:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384535.568529:0:5771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384535.568537:0:5771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a200 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:2.0:1787384535.568540:0:5771:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384535.568549:0:5771:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384535.568557:0:5771:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384535.568563:0:5771:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384535.568565:0:5771:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787384535.568568:0:5771:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787384535.568587:0:5771:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e351f82800 00010000:00010000:2.0:1787384535.568591:0:5771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384535.568598:0:5771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e35108a200/0x3522fbed3b6c3364 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3522fbed3b6c336b expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384535.568609:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384535.568610:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384535.568622:0:5771:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384535.569219:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874208195958272:0@lo:38:kworker.0 00010000:00010000:3.0:1787384535.570308:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.570323:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.570331:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.570337:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.570373:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384535.570381:0:13128:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.570388:0:13128:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.570394:0:13128:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.570400:0:13128:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384535.570420:0:13128:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1787384535.570424:0:13128:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1787384535.570445:0:13128:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1787384535.570450:0:13128:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1787384535.570454:0:13128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787384535.570459:0:13128:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1787384535.570463:0:13128:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff89e3741a4d40) has no exports 00000020:00080000:3.0:1787384535.570483:0:13128:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff89e3741a4d40) has no exports 00010000:00010000:0.0:1787384535.571058:0:8293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384535.571066:0:8293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384535.571074:0:8293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b600 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384535.571078:0:8293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384535.571087:0:8293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384535.571094:0:8293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384535.571100:0:8293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787384535.571102:0:8293:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1787384535.571104:0:8293:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1787384535.571117:0:8293:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e351f82800 00010000:00010000:0.0:1787384535.571120:0:8293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384535.571135:0:8293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c3379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x3522fbed3b6c3380 expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384535.571147:0:8293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384535.571151:0:8293:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384535.571157:0:8293:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a000 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384535.571160:0:8293:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384535.571167:0:8293:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384535.571173:0:8293:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384535.571178:0:8293:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1787384535.571181:0:8293:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1787384535.571182:0:8293:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1787384535.571188:0:8293:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e351f82800 00010000:00010000:0.0:1787384535.571190:0:8293:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384535.571195:0:8293:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c35b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x3522fbed3b6c35be expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384535.571206:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384535.571208:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384535.571215:0:8293:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384535.571324:0:8292:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1787384535.574234:0:13128:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89e379f71180 - data ffff89e2414afca8/ffff89e37b2a4800 00000020:01000000:3.0:1787384535.574380:0:13128:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff89e349f8bea0 - data ffff89e36db7da20/ffff89e242942c00 00100000:10000000:3.0:1787384535.592603:0:13128:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787384535.635815:0:13128:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3268 00000020:00000080:2.0:1787384535.635824:0:13128:0:(genops.c:906:class_export_put()) final put ffff89e37b8f2800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1787384535.635842:0:13128:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e349e43000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1787384535.635846:0:13128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e349e43000 2 00000020:01000004:2.0:1787384535.635849:0:13128:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff89e349e43000 from lustre-OST0001 00000020:00000080:1.0:1787384535.635947:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37b8f2800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1787384535.636107:0:13128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384535.636117:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1787384535.636120:0:13128:0:(genops.c:906:class_export_put()) final put ffff89e377d8d000/lustre-OST0001_UUID 00000020:00000080:2.0:1787384535.636123:0:13128:0:(genops.c:865:class_export_destroy()) destroying export ffff89e377d8d000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1787384535.636129:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1787384535.638854:0:13128:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9->MGS 00010000:00010000:2.0:1787384535.639139:0:13128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e3413fc800/0x3522fbed3b6c316c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c3173 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384535.639155:0:13128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e3413fc800/0x3522fbed3b6c316c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c3173 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384535.639160:0:13128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1787384535.639163:0:13128:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1787384535.639366:0:13128:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1787384535.639398:0:13128:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e351f82800 00010000:00010000:2.0:1787384535.639403:0:13128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e3413fc800/0x3522fbed3b6c316c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3522fbed3b6c3173 expref: -99 pid: 6571 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384535.639424:0:13128:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340030a00/0x3522fbed3b6c33c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x3522fbed3b6c33cd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384535.639431:0:13128:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340030a00/0x3522fbed3b6c33c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x3522fbed3b6c33cd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384535.639435:0:13128:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787384535.639719:0:13128:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1787384535.639721:0:13128:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1787384535.639732:0:13128:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff89e351f82800 00010000:00010000:2.0:1787384535.639736:0:13128:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340030a00/0x3522fbed3b6c33c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x3522fbed3b6c33cd expref: -99 pid: 5780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787384535.639754:0:13128:0:(import.c:65:import_set_state_nolock()) ffff89e351f82800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1787384535.639759:0:13128:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787384535.639765:0:13128:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787384535.639766:0:13128:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787384535.639772:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787384535.639825:0:13128:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff89e37315ce00 x1874208195958784/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787384542 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787384535.641416:0:13128:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787384535.641433:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:0.0:1787384535.642374:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9:3303:1874208195958784:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:2.0:1787384535.642443:0:13128:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787384535.642456:0:13128:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c305b 00000020:00000080:2.0:1787384535.642465:0:13128:0:(genops.c:906:class_export_put()) final put ffff89e351f87000/0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9 00000020:01000000:2.0:1787384535.642486:0:13128:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.203.151@tcp (flags='') 00000020:00000080:2.0:1787384535.642508:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e351f87000/0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9 for MGC192.168.203.151@tcp 00000020:00000080:2.0:1787384535.642529:0:13128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384535.642548:0:13128:0:(obd_config.c:955:class_cleanup()) MGC192.168.203.151@tcp: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787384535.642552:0:13128:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff89e351ef8000) has no exports 10000000:01000000:2.0:1787384535.642568:0:5780:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1787384535.642636:0:13128:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.203.151@tcp: client import never connected 00000100:00080000:2.0:1787384535.642639:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1787384535.642642:0:13128:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1787384535.642644:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1787384535.642646:0:13128:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1787384535.642678:0:13128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787384535.642684:0:13128:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.151@tcp (uuid 0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9) 00000020:01000000:2.0:1787384535.642689:0:13128:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1787384535.642693:0:13128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787384535.642696:0:13128:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787384535.642701:0:13128:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff89e379ff7000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787384535.642707:0:13128:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff89e37b3e4d40) has exports, disconnecting them 00000020:00080000:2.0:1787384535.642711:0:13128:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff89e379ff7000), last request at 1787384324 00000020:00000080:2.0:1787384535.642715:0:13128:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3292 00000020:00080000:2.0:1787384535.642725:0:13128:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff89e379ff7000): rc 0 00000020:00000080:2.0:1787384535.642728:0:13128:0:(genops.c:906:class_export_put()) final put ffff89e379ff7000/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787384535.642757:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e379ff7000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1787384535.650461:0:13128:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1787384535.650469:0:13128:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787384535.650473:0:13128:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787384535.650480:0:13128:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787384535.650652:0:13128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787384535.650661:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:0.0:1787384535.650669:0:13128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e349e43000 1 00000020:00000080:0.0:1787384535.650675:0:13128:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x3522fbed3b6c3237 00000020:00000080:0.0:1787384535.650683:0:13128:0:(genops.c:906:class_export_put()) final put ffff89e349e46000/lustre-OST0001-osd_UUID 00000020:01000000:0.0:1787384535.650688:0:13128:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:0.0:1787384535.650696:0:13128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787384535.650700:0:13128:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1787384535.650703:0:13128:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff89e3741a3380) has no exports 00000020:00000080:2.0:1787384535.651904:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e351f82800 for MGC192.168.203.151@tcp 00000020:00000080:2.0:1787384535.651915:0:36:0:(genops.c:906:class_export_put()) final put ffff89e351f87800/0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9 00000020:00000080:2.0:1787384535.651919:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e351f87800/0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9 for MGC192.168.203.151@tcp 00000020:01000000:2.0:1787384535.651926:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.151@tcp (0ede9fc5-6cf9-44f6-8f3a-07a13711c5e9) 00010000:00010000:0.0:1787384535.653304:0:5772:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1787384535.661734:0:5771:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787384535.668106:0:8293:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00010000:00010000:0.0:1787384535.672393:0:8292:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-4 blwis in pool) 00000100:00100000:1.0:1787384535.674150:0:5766:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff89e3512d1000:5766] 0 exiting: rc = 1 00000100:00100000:1.0:1787384535.674228:0:5767:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff89e3430ac600:5767] 1 exiting: rc = 0 00000100:00100000:2.0:1787384535.675109:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.676980:0:7472:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff89e373396600:7472] 3 exiting: rc = 0 00000100:00100000:1.0:1787384535.676980:0:5769:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff89e3430acc00:5769] 1 exiting: rc = 0 00000100:00100000:2.0:1787384535.677730:0:5770:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff89e3430ac800:5770] 2 exiting: rc = 0 00000100:00100000:2.0:1787384535.678105:0:5768:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff89e3430ad800:5768] 0 exiting: rc = 1 00000100:00100000:2.0:1787384535.678157:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678245:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678251:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678257:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678263:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678269:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678274:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678280:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678286:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678291:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678297:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678303:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678312:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678317:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678323:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678328:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678334:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678339:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678345:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678350:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678355:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678360:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678365:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678371:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678376:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678381:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678385:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678390:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678395:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678398:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678403:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678407:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678411:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678416:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678420:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678425:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678437:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678442:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678447:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678452:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678458:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678462:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678466:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678471:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678476:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678481:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678486:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678810:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678819:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678824:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678829:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678834:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678839:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678844:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678849:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678854:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678888:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678894:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678899:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678903:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678909:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678914:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678919:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787384535.678924:0:36:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1787384535.680124:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff89e377d8a800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1787384535.680134:0:36:0:(genops.c:906:class_export_put()) final put ffff89e34607e000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1787384535.680137:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e34607e000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1787384535.680142:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1787384535.680328:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff89e349e46000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787384535.693348:0:13128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384535.693365:0:13128:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787384535.693372:0:13128:0:(genops.c:906:class_export_put()) final put ffff89e349e41800/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787384535.693389:0:13128:0:(genops.c:865:class_export_destroy()) destroying export ffff89e349e41800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787384535.693403:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787384535.693589:0:13128:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff89e349e44000 00000020:01000000:1.0:1787384535.693613:0:13128:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787384535.693617:0:13128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787384535.693621:0:13128:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787384535.693625:0:13128:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff89e37b3e3380) has no exports 00000020:00000080:1.0:1787384535.693647:0:13128:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787384535.693652:0:13128:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787384535.693655:0:13128:0:(genops.c:906:class_export_put()) final put ffff89e37c5dd800/OSS_uuid 00000020:00000080:1.0:1787384535.693657:0:13128:0:(genops.c:865:class_export_destroy()) destroying export ffff89e37c5dd800/OSS_uuid for OSS 00000020:01000000:1.0:1787384535.693661:0:13128:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:2.0:1787384535.695690:0:5779:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787384535.696268:0:10631:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff89e3732ab000:10631] 3 exiting: rc = 0 00000100:00100000:0.0:1787384535.696369:0:6576:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff89e346102200:6576] 2 exiting: rc = 0 00000100:00100000:0.0:1787384535.696424:0:6575:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff89e347a9de00:6575] 1 exiting: rc = 0 00000100:00100000:0.0:1787384535.699955:0:6574:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff89e37424ce00:6574] 0 exiting: rc = 1 00000100:00100000:1.0:1787384535.700154:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700188:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700198:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700205:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700210:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700220:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700225:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700231:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700237:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700242:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700250:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700256:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700261:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700266:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700272:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700277:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700282:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700287:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700293:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700298:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700303:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700308:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700325:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700330:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700335:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700340:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700345:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700350:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700355:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700359:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700364:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700369:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700375:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700380:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700386:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700391:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700395:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700400:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700405:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700411:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700416:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700421:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700426:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700431:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700435:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700441:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700446:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700451:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700456:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700463:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700469:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700474:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700481:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700486:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700493:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700519:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700526:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700539:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700555:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700562:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700567:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700572:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700577:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.700581:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384535.701995:0:6578:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff89e346102600:6578] 1 exiting: rc = 0 00000100:00100000:1.0:1787384535.708552:0:6577:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff89e346102a00:6577] 0 exiting: rc = 1 00000100:00100000:1.0:1787384535.729124:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729137:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729142:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729147:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729152:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729157:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729163:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729168:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729174:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729179:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729183:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729188:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729193:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729199:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729204:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729209:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729214:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729219:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729224:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729230:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729235:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729240:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729244:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729249:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729254:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729259:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729264:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729283:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729289:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729295:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729300:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729305:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729310:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729316:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729322:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729327:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729332:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729338:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729343:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729348:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729352:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729357:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729362:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729366:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729371:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729376:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729380:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729385:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729389:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729394:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729399:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729406:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729412:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729417:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729422:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729427:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729432:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729437:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729442:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729447:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729452:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729456:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729467:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.729478:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787384535.731039:0:6581:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff89e37c2f4a00:6581] 2 exiting: rc = 0 00000100:00100000:1.0:1787384535.731239:0:6580:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff89e349f19200:6580] 1 exiting: rc = 0 00000100:00100000:2.0:1787384535.734825:0:6579:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff89e37b6f7600:6579] 0 exiting: rc = 1 00000100:00100000:1.0:1787384535.735196:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735204:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735210:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735216:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735222:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735240:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735247:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735253:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735258:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735264:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735270:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735275:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735281:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735287:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735293:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735298:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735304:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735309:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735316:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735321:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735326:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735331:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735336:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735341:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735346:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735352:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735358:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735363:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735369:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735389:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735396:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735402:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735419:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735424:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735431:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735443:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735448:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735454:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735460:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735465:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735470:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735475:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735480:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735485:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735490:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735495:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735501:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735506:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735511:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735516:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735521:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735527:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735533:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735539:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735558:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735565:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735571:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735575:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735581:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735596:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735616:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735623:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735630:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.735648:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.749337:0:6582:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff89e37c2f4e00:6582] 0 exiting: rc = 1 00000100:00100000:1.0:1787384535.753050:0:6583:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff89e37c2f6800:6583] 1 exiting: rc = 0 00000100:00100000:3.0:1787384535.754161:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754170:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754175:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754188:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754205:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754210:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754215:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754220:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754224:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754230:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754237:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754242:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754247:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754252:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754257:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754262:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754266:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754271:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754276:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754282:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754301:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754308:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754313:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754318:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754323:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754329:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754334:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754339:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754344:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754349:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754354:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754358:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754363:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754368:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754372:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754377:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754382:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754387:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754391:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754403:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754408:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754412:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754418:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754423:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754429:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754434:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754439:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754444:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754448:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754453:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754459:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754464:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754469:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754473:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754478:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754482:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754486:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754491:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754496:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754513:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754520:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754524:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754529:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.754534:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787384535.755673:0:6584:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff89e37c2f7a00:6584] 0 exiting: rc = 1 00000100:00100000:1.0:1787384535.755765:0:6585:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff89e37c2f7400:6585] 1 exiting: rc = 0 00000100:00100000:3.0:1787384535.755850:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755883:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755892:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755920:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755925:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755933:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755938:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755944:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755949:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755954:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755973:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755979:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755985:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755990:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.755996:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756015:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756023:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756029:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756035:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756040:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756045:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756054:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756062:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756070:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756075:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756080:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756085:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756102:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756107:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756112:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756117:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756124:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756129:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756137:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756142:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756150:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756155:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756160:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756165:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756364:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756373:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756379:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756385:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756391:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756397:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756411:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756417:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756423:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756429:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756434:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756440:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756461:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756468:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756474:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756480:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756486:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756495:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756568:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756577:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756582:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756588:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756594:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756600:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787384535.756607:0:13128:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1787384535.784228:0:13128:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:3.0:1787384554.559178:0:13743:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787384562.920855:0:14155:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787384562.920887:0:14155:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787384562.921015:0:14155:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89e372969000 00000020:01000004:3.0:1787384562.921031:0:14155:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787384562.921040:0:14155:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787384562.921053:0:14155:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff89e3741a0000) 00000020:00000080:3.0:1787384562.921076:0:14155:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787384562.952621:0:14155:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787384562.962594:0:14155:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787384562.963028:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 393: rc = 0 00100000:10000000:2.0:1787384562.963808:0:14155:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787384562.963899:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 393: rc = 0 00100000:10000000:2.0:1787384562.964471:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 393: rc = 0 00100000:10000000:2.0:1787384562.964581:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 393: rc = 0 00100000:10000000:2.0:1787384562.964673:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 393: rc = 0 00100000:10000000:2.0:1787384562.964765:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 393: rc = 0 00100000:10000000:2.0:1787384562.965580:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 395: rc = 0 00100000:10000000:2.0:1787384562.967097:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 467: rc = 0 00100000:10000000:2.0:1787384562.967203:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 467: rc = 0 00100000:10000000:2.0:1787384562.967584:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 332: rc = 0 00100000:10000000:2.0:1787384562.967961:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 332: rc = 0 00100000:10000000:2.0:1787384562.968214:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 332: rc = 0 00100000:10000000:2.0:1787384562.968450:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 332: rc = 0 00100000:10000000:2.0:1787384562.968683:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 332: rc = 0 00100000:10000000:2.0:1787384562.969718:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 332: rc = 0 00100000:10000000:2.0:1787384562.971611:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 332: rc = 0 00100000:10000000:2.0:1787384562.971948:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 332: rc = 0 00100000:10000000:2.0:1787384562.972648:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 332: rc = 0 00100000:10000000:2.0:1787384562.972962:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 332: rc = 0 00100000:10000000:2.0:1787384562.973465:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 332: rc = 0 00100000:10000000:2.0:1787384562.973711:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 332: rc = 0 00100000:10000000:2.0:1787384562.974711:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 651: rc = 0 00100000:10000000:2.0:1787384562.975205:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 651: rc = 0 00100000:10000000:2.0:1787384562.975446:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 651: rc = 0 00100000:10000000:2.0:1787384562.975700:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 651: rc = 0 00100000:10000000:2.0:1787384562.976233:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 651: rc = 0 00100000:10000000:2.0:1787384562.976503:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 651: rc = 0 00100000:10000000:2.0:1787384562.976750:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 651: rc = 0 00100000:10000000:2.0:1787384562.981277:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 651: rc = 0 00100000:10000000:2.0:1787384562.982890:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 651: rc = 0 00100000:10000000:2.0:1787384562.983220:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 651: rc = 0 00100000:10000000:2.0:1787384562.983452:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 651: rc = 0 00100000:10000000:2.0:1787384562.983680:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 651: rc = 0 00100000:10000000:2.0:1787384562.984287:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 651: rc = 0 00100000:10000000:2.0:1787384562.984619:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 651: rc = 0 00100000:10000000:2.0:1787384562.984917:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 651: rc = 0 00100000:10000000:3.0:1787384562.988517:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 651: rc = 0 00100000:10000000:3.0:1787384562.988917:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 651: rc = 0 00100000:10000000:3.0:1787384562.989379:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 651: rc = 0 00100000:10000000:3.0:1787384562.990395:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 651: rc = 0 00100000:10000000:3.0:1787384562.990765:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 651: rc = 0 00100000:10000000:3.0:1787384562.991891:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 651: rc = 0 00100000:10000000:3.0:1787384562.992708:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 651: rc = 0 00100000:10000000:3.0:1787384562.993117:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 651: rc = 0 00100000:10000000:3.0:1787384562.993407:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 651: rc = 0 00100000:10000000:3.0:1787384562.993726:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 651: rc = 0 00100000:10000000:3.0:1787384562.994499:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 651: rc = 0 00100000:10000000:3.0:1787384562.995231:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 651: rc = 0 00100000:10000000:3.0:1787384562.995472:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 651: rc = 0 00100000:10000000:3.0:1787384562.996233:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 651: rc = 0 00100000:10000000:3.0:1787384562.996490:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 651: rc = 0 00100000:10000000:3.0:1787384562.997405:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 651: rc = 0 00100000:10000000:3.0:1787384562.997840:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 651: rc = 0 00100000:10000000:3.0:1787384562.998428:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 475: rc = 0 00100000:10000000:3.0:1787384563.002960:0:14155:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787384563.003144:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 468: rc = 0 00100000:10000000:3.0:1787384563.003347:0:14155:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787384563.003419:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 468: rc = 0 00100000:10000000:3.0:1787384563.003604:0:14155:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787384563.003670:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 468: rc = 0 00100000:10000000:3.0:1787384563.004049:0:14155:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787384563.004123:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 581: rc = 0 00100000:10000000:3.0:1787384563.004318:0:14155:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787384563.004384:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 581: rc = 0 00100000:10000000:3.0:1787384563.004562:0:14155:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787384563.004631:0:14155:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 581: rc = 0 00000020:00000080:3.0:1787384563.004936:0:14155:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787384563.004944:0:14155:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787384563.004952:0:14155:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c435c 00000020:01000004:3.0:1787384563.004960:0:14155:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787384563.004965:0:14155:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787384563.004970:0:14155:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e372969000 from MGS 00000020:01000004:3.0:1787384563.004973:0:14155:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787384563.004983:0:14155:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff89e3741a3380) 00000020:00000080:3.0:1787384563.004992:0:14155:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787384563.005038:0:14155:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e372969000 from MGS, refs=2 00080000:01000000:3.0:1787384563.005043:0:14155:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787384563.005048:0:14155:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c436a 00000100:00100000:3.0:1787384563.005136:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787384563.005252:0:14155:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787384563.005258:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787384563.009257:0:14155:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787384563.009272:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1787384563.010990:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384563.011493:0:14155:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1787384563.011499:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787384563.012510:0:14155:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787384563.012519:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1787384563.013136:0:14155:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1787384563.013143:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1787384563.020427:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384563.020432:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384563.020435:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384563.020822:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384563.020824:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384563.020826:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384563.021698:0:14155:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1787384563.026372:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1787384563.037503:0:14155:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:2.0:1787384563.037520:0:14155:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787384563.037523:0:14155:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1787384563.039337:0:14164:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1787384563.039469:0:14155:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1787384563.039579:0:14155:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787384563.040768:0:14155:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1787384563.041671:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384563.041836:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1787384563.041842:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1787384563.047040:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1787384563.047125:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1787384563.051237:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1787384563.051249:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1787384563.052011:0:14155:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1787384563.052032:0:14155:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.151@tcp' 00000020:01000004:2.0:1787384563.052034:0:14155:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1787384563.052074:0:14155:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.151@tcp (typ=mgc) 00000020:00000080:2.0:1787384563.052088:0:14155:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.151@tcp (ffff89e351f64d40) 00000020:00000080:2.0:1787384563.052103:0:14155:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1787384563.052179:0:14155:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e37b8f5800@MGC192.168.203.151@tcp: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1787384563.052318:0:14155:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.151@tcp-0 is initialized 00000040:01000000:2.0:1787384563.052323:0:14155:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 1 is initialized 00000100:00080000:1.0:1787384563.052438:0:14169:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787384563.058110:0:14170:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1787384563.058280:0:14155:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.151@tcp (uuid a0a21a99-396b-46a4-a5fe-afbe14b55ea8) 00000020:00000080:3.0:1787384563.058308:0:14155:0:(genops.c:1406:class_connect()) connect: client a0a21a99-396b-46a4-a5fe-afbe14b55ea8, cookie 0x3522fbed3b6c4378 00000100:00080000:3.0:1787384563.058320:0:14155:0:(import.c:510:import_select_connection()) MGC192.168.203.151@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787384563.058327:0:14155:0:(import.c:624:import_select_connection()) MGC192.168.203.151@tcp: import ffff89e37b8f5800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1787384563.058363:0:14155:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37c4e7480 x1874208195958912/t0(0) o250->MGC192.168.203.151@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384563.058389:0:14155:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import a0a21a99-396b-46a4-a5fe-afbe14b55ea8->MGS 00000020:01000004:3.0:1787384563.058415:0:14155:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1787384563.058420:0:14155:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1787384563.058448:0:14155:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff89e3741a4d40) 00000020:00000080:3.0:1787384563.058460:0:14155:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787384563.060603:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3303:1874208195958912:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787384563.060676:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384563.060890:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195958912 00000100:00100000:1.0:1787384563.060899:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195958912 00000100:00100000:1.0:1787384563.060934:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384563.060950:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3303:x1874208195958912:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787384563.060977:0:14165:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a0a21a99-396b-46a4-a5fe-afbe14b55ea8@0@lo t0 exp 0000000000000000 cur 424 last 0 00000020:00000080:1.0:1787384563.061005:0:14165:0:(genops.c:1406:class_connect()) connect: client a0a21a99-396b-46a4-a5fe-afbe14b55ea8, cookie 0x3522fbed3b6c4386 00000100:00080000:1.0:1787384563.061151:0:14165:0:(import.c:65:import_set_state_nolock()) ffff89e34785e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787384563.061216:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+5:3303:x1874208195958912:12345-0@lo:250:mount.lustre.0 Request processed in 264us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.061224:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384563.061520:0:3303:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.203.151@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787384563.061529:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.151@tcp: connect to target with instance 0 00000100:00080000:0.0:1787384563.061538:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.151@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787384563.061553:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787384563.061558:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e37b8f5800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787384563.061561:0:3303:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787384563.061573:0:3303:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787384563.061578:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3303:1874208195958912:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1787384563.085602:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384563.088442:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1787384563.088455:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787384563.089492:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787384563.089502:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1787384563.089946:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1787384563.089953:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1787384563.092343:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384563.092541:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1787384563.093022:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1787384563.094426:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1787384563.094437:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1787384563.163910:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787384563.164337:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1787384563.164344:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1787384563.165714:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1787384563.165726:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787384563.166674:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384563.166836:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787384563.166842:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787384563.167531:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787384563.167539:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787384563.168495:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384563.168656:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787384563.168662:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1787384563.171419:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1787384563.171432:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787384563.172398:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384563.172570:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787384563.172577:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1787384563.173381:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1787384563.173389:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787384563.200621:0:14155:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384563.201342:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787384563.201351:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787384563.202792:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787384563.202805:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787384563.203839:0:14155:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787384563.203849:0:14155:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787384563.204753:0:14155:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787384563.204782:0:14155:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787384563.204788:0:14155:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787384563.204977:0:14155:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787384563.205065:0:14155:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.151@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787384563.205070:0:14155:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787384563.205072:0:14155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787384563.205073:0:14155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384563.205074:0:14155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384563.205075:0:14155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384563.205077:0:14155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384563.205078:0:14155:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384563.205079:0:14155:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787384563.205081:0:14155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384563.205082:0:14155:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384563.205085:0:14155:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787384563.205087:0:14155:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787384563.205088:0:14155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787384563.205089:0:14155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384563.205090:0:14155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384563.205097:0:14155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384563.205098:0:14155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384563.205099:0:14155:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384563.205100:0:14155:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787384563.205101:0:14155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384563.205101:0:14155:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384563.205135:0:14155:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787384563.205154:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959040:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787384563.205444:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384563.205536:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aefcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.205575:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195959040 00000100:00100000:1.0:1787384563.205582:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195959040 00000100:00100000:1.0:1787384563.205645:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384563.205654:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+5:14155:x1874208195959040:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787384563.205694:0:14168:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787384563.205701:0:14168:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787384563.205703:0:14168:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787384563.206013:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1787384563.206546:0:14168:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:0.0:1787384563.207703:0:14190:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:0.0:1787384563.207709:0:14190:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:0.0:1787384563.207711:0:14190:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:0.0:1787384563.207742:0:14190:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:2.0:1787384563.208142:0:14168:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787384563.208152:0:14168:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787384563.215718:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+5:14155:x1874208195959040:12345-0@lo:253:mount.lustre.0 Request processed in 10055us (10265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384563.215737:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384563.216280:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959040:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787384563.216295:0:14155:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1787384563.216298:0:14155:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384563.216300:0:14155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1787384563.216301:0:14155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384563.216311:0:14155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384563.216313:0:14155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384563.216314:0:14155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384563.216316:0:14155:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1787384563.216317:0:14155:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1787384563.216319:0:14155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384563.216320:0:14155:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787384563.216354:0:14155:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e372969000 from lustre-MDT0000 10000000:01000000:3.0:1787384563.216380:0:14155:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1787384563.216496:0:14155:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787384563.216501:0:14155:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff89e351f64d40 10000000:01000000:3.0:1787384563.216506:0:14155:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384563.216514:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff89e351f64d40 from 1 10000000:01000000:3.0:1787384563.216517:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1787384563.216555:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.216567:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.216577:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384563.216597:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959168:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384563.216637:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384563.216673:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384563.216728:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195959168 00000100:00100000:0.0:1787384563.216734:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195959168 00000100:00100000:0.0:1787384563.216854:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384563.216892:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+5:14155:x1874208195959168:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384563.216905:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384563.216919:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108a600/0x3522fbed3b6c4394 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c438d expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.216942:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108a600/0x3522fbed3b6c4394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c438d expref: 6 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.216953:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108a600/0x3522fbed3b6c4394 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c438d expref: 6 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.216962:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a600, rc 0) 00000100:00100000:0.0:1787384563.217222:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+6:14155:x1874208195959168:12345-0@lo:101:mount.lustre.0 Request processed in 332us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384563.217229:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384563.217283:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959168:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384563.217295:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4394 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.217366:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c4394 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384563.217489:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959296:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384563.217517:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384563.217574:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db53c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384563.217613:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195959296 00000100:00100000:0.0:1787384563.217617:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195959296 00000100:00100000:0.0:1787384563.217676:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384563.217684:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+6:14155:x1874208195959296:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384563.217947:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+6:14155:x1874208195959296:12345-0@lo:501:mount.lustre.0 Request processed in 263us (428us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384563.217954:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384563.217969:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959296:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787384563.218007:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787384563.218022:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4394 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.218030:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4394 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384563.218038:0:14155:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e372969000 10000000:01000000:2.0:1787384563.218043:0:14155:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787384563.218047:0:14155:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff89e372969000 10000000:01000000:2.0:1787384563.218050:0:14155:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1787384563.218053:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff89e372969000 from 1 10000000:01000000:2.0:1787384563.218063:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1787384563.218085:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb3e00/0x3522fbed3b6c439b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.218092:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e379eb3e00/0x3522fbed3b6c439b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.218111:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e379eb3e00/0x3522fbed3b6c439b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384563.218124:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959424:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384563.218152:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384563.218576:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3742f8180 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.218617:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195959424 00000100:00100000:1.0:1787384563.218621:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195959424 00000100:00100000:0.0:1787384563.218655:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384563.218664:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+6:14155:x1874208195959424:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384563.218673:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384563.218685:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108b800/0x3522fbed3b6c43a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c439b expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.218705:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108b800/0x3522fbed3b6c43a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c439b expref: 7 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.218715:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108b800/0x3522fbed3b6c43a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c439b expref: 7 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.218723:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b800, rc 0) 00000100:00100000:2.0:1787384563.218827:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959424:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787384563.218827:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+7:14155:x1874208195959424:12345-0@lo:101:mount.lustre.0 Request processed in 164us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384563.218834:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:2.0:1787384563.218839:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e379eb3e00/0x3522fbed3b6c439b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c43a2 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.218847:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e379eb3e00/0x3522fbed3b6c439b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c43a2 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384563.218946:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1787384563.218954:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb3e00/0x3522fbed3b6c439b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c43a2 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.218961:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e379eb3e00/0x3522fbed3b6c439b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c43a2 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384563.218966:0:14155:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1787384563.218970:0:14155:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384563.218975:0:14155:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff89e372969000 10000000:01000000:2.0:1787384563.219279:0:14155:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1787384563.219285:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1787384563.219287:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787384563.219377:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb2800/0x3522fbed3b6c43a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.219464:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e379eb2800/0x3522fbed3b6c43a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.219472:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e379eb2800/0x3522fbed3b6c43a9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384563.219488:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384563.219521:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384563.219549:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3742f8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787384563.219622:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195959552 00000100:00100000:3.0:1787384563.219627:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195959552 00000100:00100000:3.0:1787384563.219660:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384563.219668:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+7:14155:x1874208195959552:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384563.219677:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384563.219688:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340031800/0x3522fbed3b6c43b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c43a9 expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.219703:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340031800/0x3522fbed3b6c43b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c43a9 expref: 8 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.219712:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340031800/0x3522fbed3b6c43b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c43a9 expref: 8 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.219719:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031800, rc 0) 00000100:00100000:3.0:1787384563.219967:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+8:14155:x1874208195959552:12345-0@lo:101:mount.lustre.0 Request processed in 299us (445us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384563.219974:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384563.220174:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384563.220186:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e379eb2800/0x3522fbed3b6c43a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c43b0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.220196:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e379eb2800/0x3522fbed3b6c43a9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c43b0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384563.220242:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384563.220267:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384563.220290:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3742f8180 going to sleep for 11 seconds 00000100:00100000:3.0:1787384563.220450:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195959680 00000100:00100000:3.0:1787384563.220455:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195959680 00000100:00100000:3.0:1787384563.220480:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384563.220486:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+8:14155:x1874208195959680:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384563.221157:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+9:14155:x1874208195959680:12345-0@lo:501:mount.lustre.0 Request processed in 669us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384563.221165:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384563.221227:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384563.221260:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384563.221299:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384563.221460:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3742f8180 going to sleep for 11 seconds 00000100:00100000:0.0:1787384563.221493:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195959808 00000100:00100000:0.0:1787384563.221498:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195959808 00000100:00100000:0.0:1787384563.221559:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787384563.221566:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+9:14155:x1874208195959808:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384563.222458:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+9:14155:x1874208195959808:12345-0@lo:503:mount.lustre.0 Request processed in 890us (1155us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384563.222466:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384563.222529:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195959808:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384563.224357:0:14191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14191:1874208195959936:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384563.224540:0:14191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384563.224621:0:14191:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3742f8600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384563.224669:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195959936 00000100:00100000:0.0:1787384563.224676:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195959936 00000100:00100000:0.0:1787384563.224767:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787384563.224786:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+9:14191:x1874208195959936:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384563.225175:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+9:14191:x1874208195959936:12345-0@lo:502:llog_process_th.0 Request processed in 381us (625us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384563.225184:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384563.225687:0:14191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14191:1874208195959936:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787384563.225716:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384563.225725:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384563.225727:0:14191:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787384563.225731:0:14191:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1787384563.225734:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384563.225747:0:14191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff89e351f63380) 00000020:00000080:2.0:1787384563.225834:0:14191:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1787384563.225840:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1787384563.225927:0:14191:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1787384563.225933:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c43be 00000020:00000080:2.0:1787384563.226265:0:14191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787384563.226270:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384563.226274:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384563.226275:0:14191:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1787384563.226278:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384563.226281:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384563.226282:0:14191:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1787384563.226285:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787384563.226292:0:14191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff89e351f619c0) 00000020:00000080:2.0:1787384563.226314:0:14191:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1787384563.226320:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1787384563.226321:0:14191:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1787384563.226324:0:14191:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1787384563.226329:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787384563.226375:0:14191:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e372969000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1787384563.226513:0:14191:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff89e351f60000) 00000020:00000080:2.0:1787384563.226523:0:14191:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1787384563.226577:0:14191:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1787384563.226591:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3522fbed3b6c43d3 00000020:00000080:2.0:1787384563.226685:0:14191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1787384563.226691:0:14191:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1787384563.226695:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x3522fbed3b6c43da 00080000:01000000:2.0:1787384563.226700:0:14191:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1787384563.226705:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c43e1 00010000:00010000:3.0:1787384563.337031:0:14191:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1787384563.337816:0:14191:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1787384563.342055:0:14191:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1787384563.342640:0:14191:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff89e37aa48000) 00000020:00000080:2.0:1787384563.342662:0:14191:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1787384563.342726:0:14191:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1787384563.342732:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c43ef 00000020:00000080:1.0:1787384563.352608:0:14191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1787384563.362958:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x3522fbed3b6c43f6 00000020:00000080:1.0:1787384563.363595:0:14191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787384563.363606:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384563.363612:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.363615:0:14191:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787384563.363618:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787384563.363620:0:14191:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1787384563.363622:0:14191:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787384563.363624:0:14191:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787384563.363625:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787384563.363628:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.363630:0:14191:0:(obd_config.c:1561:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787384563.363632:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384563.363636:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.363638:0:14191:0:(obd_config.c:1561:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787384563.363643:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787384563.363682:0:14191:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787384563.363696:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384563.363700:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.363701:0:14191:0:(obd_config.c:1561:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787384563.363704:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787384563.363707:0:14191:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787384563.363710:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.363711:0:14191:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787384563.363714:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787384563.363719:0:14191:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:1.0:1787384563.363744:0:14191:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787384563.363754:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384563.363768:0:14191:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff89e37b274d40) 00000020:00000080:1.0:1787384563.363794:0:14191:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787384563.363800:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787384563.363852:0:14191:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787384563.363889:0:14191:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787384563.363897:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c4404 00010000:00080000:1.0:1787384563.363928:0:14191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e372b98000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1787384563.364164:0:14191:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787384563.364583:0:14191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787384563.364627:0:14191:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787384563.366065:0:14191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384563.366140:0:14191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787384563.366398:0:14191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:3.0:1787384563.367511:0:14195:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787384563.367516:0:14195:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1787384563.367788:0:14191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787384563.367800:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787384563.367833:0:14191:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1787384563.367851:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3522fbed3b6c440b 00000100:00080000:1.0:1787384563.367967:0:14191:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384563.367973:0:14191:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e372b98000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1787384563.368008:0:14191:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37315dc00 x1874208195960064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384563.368124:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195960064:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787384563.368180:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208195960064 offset 0 length 520: 4 00000100:00080000:1.0:1787384563.368238:0:14191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787384563.368316:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384563.368321:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.368323:0:14191:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787384563.368326:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787384563.368328:0:14191:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:1.0:1787384563.368330:0:14191:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787384563.368332:0:14191:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787384563.368333:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787384563.368343:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.368345:0:14191:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787384563.368348:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787384563.368352:0:14191:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787384563.368355:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.368357:0:14191:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787384563.368359:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787384563.368363:0:14191:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.203.151@tcp to nid 0x20000c0a8cb97 (192.168.203.151@tcp) 00000020:01000000:1.0:1787384563.368392:0:14191:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787384563.368395:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787384563.368407:0:14191:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff89e37b270000) 00000020:00000080:1.0:1787384563.368420:0:14191:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787384563.368425:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787384563.368481:0:14191:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787384563.368487:0:14191:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787384563.368494:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x3522fbed3b6c4419 00010000:00080000:1.0:1787384563.368525:0:14191:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e349ebd800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1787384563.368715:0:14191:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787384563.368907:0:14191:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787384563.368929:0:14191:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787384563.369550:0:14191:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787384563.369617:0:14191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787384563.369681:0:14191:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1787384563.370603:0:14197:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787384563.370608:0:14197:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787384563.371837:0:14191:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787384563.371850:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787384563.372005:0:14191:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787384563.372023:0:14191:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3522fbed3b6c4420 00000100:00080000:1.0:1787384563.372032:0:14191:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384563.372038:0:14191:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e349ebd800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1787384563.372140:0:14191:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37315c000 x1874208195960192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384563.372175:0:14191:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787384563.372230:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384563.372235:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.372236:0:14191:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787384563.372239:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384563.372242:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.372243:0:14191:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787384563.372246:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787384563.372247:0:14191:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787384563.372250:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384563.372252:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.372253:0:14191:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787384563.372256:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384563.372258:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.372259:0:14191:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787384563.372263:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787384563.372293:0:14191:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14191:1874208195960320:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384563.372378:0:14191:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384563.372526:0:14191:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344099c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787384563.372583:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195960320 00000100:00100000:0.0:1787384563.372590:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195960320 00000100:00100000:0.0:1787384563.372636:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384563.372645:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+9:14191:x1874208195960320:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384563.372905:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+9:14191:x1874208195960320:12345-0@lo:502:llog_process_th.0 Request processed in 259us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384563.372912:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384563.372954:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195960192:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787384563.372978:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208195960192 offset 0 length 520: 4 00000100:00100000:1.0:1787384563.373218:0:14191:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14191:1874208195960320:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384563.373245:0:14191:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384563.373251:0:14191:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.373253:0:14191:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787384563.373256:0:14191:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787384563.373496:0:14155:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787384563.373513:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787384563.373532:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb2800/0x3522fbed3b6c43a9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c43b0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.373542:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e379eb2800/0x3522fbed3b6c43a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c43b0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384563.373548:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89e372969000 from 1 10000000:01000000:3.0:1787384563.373551:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787384563.373579:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.373587:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.373596:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384563.373611:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195960448:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384563.373642:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384563.373727:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384563.373829:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195960448 00000100:00100000:0.0:1787384563.373836:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195960448 00000100:00100000:1.0:1787384563.374372:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384563.374394:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+9:14155:x1874208195960448:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384563.374406:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384563.374425:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c442e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c4427 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384563.374459:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c442e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c4427 expref: 10 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384563.374469:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c442e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4427 expref: 10 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384563.374478:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c800, rc 0) 00000100:00100000:1.0:1787384563.374529:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+10:14155:x1874208195960448:12345-0@lo:101:mount.lustre.0 Request processed in 148us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.374535:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787384563.374606:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195960448:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384563.374620:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.374630:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384563.375216:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195960576:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1787384563.375260:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384563.375673:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384563.375751:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195960576 00000100:00100000:2.0:1787384563.375757:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195960576 00000100:00100000:2.0:1787384563.375799:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787384563.375807:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+10:14155:x1874208195960576:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1787384563.375822:0:14168:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787384563.375828:0:14168:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787384563.375918:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+10:14155:x1874208195960576:12345-0@lo:256:mount.lustre.0 Request processed in 112us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384563.375926:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384563.376006:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195960576:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1787384563.376846:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384563.376906:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.376917:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384563.376924:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e372969000 from 1 10000000:01000000:3.0:1787384563.376927:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384563.376955:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.376962:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.376970:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384563.376986:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195960704:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384563.377025:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384563.377049:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384563.377345:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195960704 00000100:00100000:2.0:1787384563.377351:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195960704 00000100:00100000:2.0:1787384563.377390:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787384563.377399:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+10:14155:x1874208195960704:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384563.377410:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384563.377426:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c443c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c4435 expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.377462:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c443c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c4435 expref: 11 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.377471:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c443c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4435 expref: 11 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.377478:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3400, rc 0) 00000100:00100000:2.0:1787384563.377512:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14155:x1874208195960704:12345-0@lo:101:mount.lustre.0 Request processed in 114us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384563.377518:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384563.377714:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195960704:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384563.377729:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384563.377750:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384563.377814:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195960832:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384563.377839:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384563.377885:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.377941:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195960832 00000100:00100000:1.0:1787384563.377946:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195960832 00000100:00100000:1.0:1787384563.377969:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787384563.377975:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14155:x1874208195960832:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384563.378597:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14155:x1874208195960832:12345-0@lo:501:mount.lustre.0 Request processed in 620us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.378606:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384563.379257:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195960832:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384563.379502:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195960960:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384563.379556:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384563.379616:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3742f8240 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.379656:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195960960 00000100:00100000:1.0:1787384563.379661:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195960960 00000100:00100000:1.0:1787384563.379735:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787384563.379744:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14155:x1874208195960960:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384563.379955:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14155:x1874208195960960:12345-0@lo:503:mount.lustre.0 Request processed in 211us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.379962:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787384563.380037:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195960960:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384563.380574:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14199:1874208195961088:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384563.380614:0:14199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384563.381290:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195961088 00000100:00100000:2.0:1787384563.381297:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195961088 00000100:00100000:2.0:1787384563.381459:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384563.381467:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14199:x1874208195961088:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787384563.381718:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14199:x1874208195961088:12345-0@lo:502:llog_process_th.0 Request processed in 251us (1103us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384563.381727:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787384563.381969:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2afcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384563.381991:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14199:1874208195961088:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787384563.382020:0:14199:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384563.382028:0:14199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384563.382031:0:14199:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787384563.382039:0:14199:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e372969000 00000020:00000080:0.0:1787384563.382041:0:14199:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384563.382049:0:14199:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384563.382051:0:14199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384563.382053:0:14199:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1787384563.382055:0:14199:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384563.382123:0:14199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384563.382125:0:14199:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787384563.382129:0:14199:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e372969000 00000020:00000080:0.0:1787384563.382131:0:14199:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787384563.382242:0:14199:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384563.382246:0:14199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384563.382248:0:14199:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1787384563.382250:0:14199:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384563.382252:0:14199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384563.382254:0:14199:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1787384563.382257:0:14199:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e372969000 00000020:00000080:0.0:1787384563.382260:0:14199:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787384563.390208:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14199:1874208195961216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384563.390294:0:14199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384563.391504:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195961216 00000100:00100000:1.0:1787384563.391515:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195961216 00000100:00100000:1.0:1787384563.391564:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384563.391573:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14199:x1874208195961216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384563.391812:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14199:x1874208195961216:12345-0@lo:502:llog_process_th.0 Request processed in 238us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.391820:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384563.391894:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3440993c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.391916:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14199:1874208195961216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787384563.391949:0:14199:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384563.391956:0:14199:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384563.391959:0:14199:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787384563.391963:0:14199:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787384563.392373:0:14155:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787384563.392458:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384563.392474:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.392486:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384563.392534:0:14155:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787384563.392537:0:14155:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e372969000 10000000:01000000:0.0:1787384563.392540:0:14155:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e372969000 10000000:01000000:0.0:1787384563.392544:0:14155:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787384563.392549:0:14155:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e372969000 from 1 10000000:01000000:0.0:1787384563.392552:0:14155:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787384563.392584:0:14155:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108be00/0x3522fbed3b6c4443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.392591:0:14155:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e35108be00/0x3522fbed3b6c4443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.392600:0:14155:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e35108be00/0x3522fbed3b6c4443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384563.392617:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195961344:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787384563.392655:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384563.392674:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2afe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384563.392696:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195961344 00000100:00100000:0.0:1787384563.392700:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195961344 00000100:00100000:0.0:1787384563.392729:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787384563.392736:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14155:x1874208195961344:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384563.392746:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384563.392759:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c444a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c4443 expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.392790:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c444a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c4443 expref: 12 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.392810:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108a800/0x3522fbed3b6c444a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4443 expref: 12 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.392817:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a800, rc 0) 00000100:00100000:0.0:1787384563.392846:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14155:x1874208195961344:12345-0@lo:101:mount.lustre.0 Request processed in 110us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384563.392852:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787384563.392912:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195961344:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384563.392924:0:14155:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e35108be00/0x3522fbed3b6c4443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c444a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.392932:0:14155:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e35108be00/0x3522fbed3b6c4443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c444a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384563.392973:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195961472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384563.392996:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384563.393010:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2afe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.393488:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195961472 00000100:00100000:1.0:1787384563.393494:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195961472 00000100:00100000:1.0:1787384563.393521:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787384563.393528:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14155:x1874208195961472:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384563.393768:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14155:x1874208195961472:12345-0@lo:501:mount.lustre.0 Request processed in 239us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.393787:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787384563.394167:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195961472:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384563.394202:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195961600:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384563.394245:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384563.394272:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2afe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.395505:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195961600 00000100:00100000:1.0:1787384563.395516:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195961600 00000100:00100000:1.0:1787384563.395559:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384563.395568:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14155:x1874208195961600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384563.395782:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14155:x1874208195961600:12345-0@lo:503:mount.lustre.0 Request processed in 202us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.395796:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1787384563.395881:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195961600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384563.397250:0:14202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14202:1874208195961728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384563.397658:0:14202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384563.397692:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195961728 00000100:00100000:1.0:1787384563.397697:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195961728 00000100:00100000:1.0:1787384563.397730:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384563.397738:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14202:x1874208195961728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787384563.397995:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14202:x1874208195961728:12345-0@lo:502:llog_process_th.0 Request processed in 256us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.398003:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787384563.398053:0:14202:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344099840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.398086:0:14202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315e680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14202:1874208195961728:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787384563.398138:0:14202:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787384563.398152:0:14202:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff89e37b2719c0) 00000020:00000080:1.0:1787384563.398170:0:14202:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787384563.401341:0:14202:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e372969000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787384563.401352:0:14202:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e372969000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787384563.401355:0:14202:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e372969000 4 00010000:00080000:1.0:1787384563.401393:0:14202:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e3450e8800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.151@tcp at head 00010000:00010000:1.0:1787384563.404239:0:14202:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787384563.404339:0:14202:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787384563.404377:0:14202:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787384563.404389:0:14202:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x3522fbed3b6c4458 00000100:00080000:1.0:1787384563.404399:0:14202:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787384563.404405:0:14202:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89e3450e8800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1787384563.404457:0:14202:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37315e680 x1874208195961856/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787384563.404486:0:14202:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787384563.404527:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874208195961856:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787384563.404593:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384563.404646:0:14202:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14202:1874208195961984:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384563.404655:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195961856 00000100:00100000:0.0:1787384563.404661:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195961856 00000100:00100000:1.0:1787384563.404687:0:14202:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384563.404695:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384563.404701:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37314b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874208195961856:12345-0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787384563.404707:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195961984 00000100:00100000:1.0:1787384563.404710:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195961984 00000100:00100000:1.0:1787384563.404733:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384563.404740:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14202:x1874208195961984:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787384563.404747:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37314b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3303:x1874208195961856:12345-0@lo:38:llog_process_th.0 Request processed in 46us (154us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787384563.404753:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384563.404797:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787384563.404804:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e3450e8800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787384563.404807:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787384563.404811:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874208195961856:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787384563.404982:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14202:x1874208195961984:12345-0@lo:502:llog_process_th.0 Request processed in 242us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.404989:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787384563.405025:0:14202:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344099840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.405036:0:14202:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315f480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14202:1874208195961984:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787384563.405056:0:14202:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1787384563.405104:0:14155:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787384563.405121:0:14155:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787384563.405139:0:14155:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108be00/0x3522fbed3b6c4443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c444a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384563.405150:0:14155:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e35108be00/0x3522fbed3b6c4443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c444a expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787384563.405188:0:14155:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787384563.405191:0:14155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787384563.405192:0:14155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384563.405193:0:14155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384563.405198:0:14155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384563.405199:0:14155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384563.405201:0:14155:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384563.405202:0:14155:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787384563.405203:0:14155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384563.405205:0:14155:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384563.405208:0:14155:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:1.0:1787384563.405210:0:14155:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787384563.405211:0:14155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787384563.405213:0:14155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384563.405213:0:14155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384563.405215:0:14155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384563.405216:0:14155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384563.405217:0:14155:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787384563.405218:0:14155:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787384563.405218:0:14155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384563.405219:0:14155:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787384563.405232:0:14155:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787384563.405241:0:14155:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195962112:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787384563.405269:0:14155:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384563.405285:0:14155:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344099840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.405300:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195962112 00000100:00100000:1.0:1787384563.405303:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195962112 00000100:00100000:1.0:1787384563.405323:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787384563.405329:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14155:x1874208195962112:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787384563.405347:0:14168:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787384563.405358:0:14168:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787384563.455706:0:14168:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787384563.455724:0:14168:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787384563.455829:0:14189:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787384563.455834:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787384563.455855:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.461154:0:14189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c442e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4427 expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.461186:0:14189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.461234:0:14189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c442e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c4427 expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.461253:0:14189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c442e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c4427 expref: 12 pid: 14165 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384563.461267:0:14189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14189:1874208195962240:0@lo:104: 00000100:00100000:2.0:1787384563.461327:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384563.461378:0:14189:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34591da80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384563.461488:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195962240 00000100:00100000:1.0:1787384563.461497:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195962240 00000100:00100000:1.0:1787384563.461543:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787384563.461552:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+3:14189:x1874208195962240:12345-0@lo:104: 00010000:00010000:1.0:1787384563.461564:0:14156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384563.461620:0:14156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787384563.461627:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+3:14189:x1874208195962240:12345-0@lo:104: Request processed in 77us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.461634:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384563.461702:0:14189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14189:1874208195962240:0@lo:104: 00010000:00010000:2.0:1787384563.461723:0:14189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.462226:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384563.462234:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.462242:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031400 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384563.462247:0:14162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.462256:0:14162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384563.462263:0:14162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384563.462269:0:14162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1787384563.462312:0:14162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.462318:0:14162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384563.462336:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.462351:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340031400/0x3522fbed3b6c4427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c442e expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384563.462368:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384563.462370:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384563.462372:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384563.462547:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3305:1874208195962368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384563.462586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384563.462689:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195962368 00000100:00100000:2.0:1787384563.462696:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195962368 00010000:00010000:2.0:1787384563.462717:0:14158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c442e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c4427 expref: 13 pid: 14165 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384563.462749:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384563.462756:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37314ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+13:3305:x1874208195962368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384563.462767:0:14158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384563.462816:0:14158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c442e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c4427 expref: 13 pid: 14165 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462826:0:14158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c442e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c4427 expref: 13 pid: 14165 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462846:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c442e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c4427 expref: 13 pid: 14165 timeout: 524 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462880:0:14158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462888:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787384563.462901:0:14158:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007067332s 00010000:00010000:2.0:1787384563.462905:0:14158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462912:0:14158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462917:0:14158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462922:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462927:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2e00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384563.462931:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462937:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462949:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.462965:0:14158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384563.463000:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37314ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:3305:x1874208195962368:12345-0@lo:103:ldlm_bl.0 Request processed in 244us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384563.463007:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1787384563.463028:0:14189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.463036:0:14189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384563.463041:0:14189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c445f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384563.463177:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3305:1874208195962368:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787384563.472727:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14155:x1874208195962112:12345-0@lo:253:mount.lustre.0 Request processed in 67389us (67448us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384563.472742:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384563.472854:0:14155:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14155:1874208195962112:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1787384563.472940:0:14155:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1787384563.472944:0:14155:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787384563.472945:0:14155:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787384563.472947:0:14155:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384563.472948:0:14155:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384563.472949:0:14155:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384563.472950:0:14155:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384563.472952:0:14155:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787384563.472953:0:14155:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787384563.472955:0:14155:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384563.472956:0:14155:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787384563.472973:0:14155:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787384563.479651:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1787384563.479834:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787384563.480170:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1787384563.480332:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787384563.480604:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787384563.480760:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1787384563.482452:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1787384563.482621:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1787384563.483263:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1787384563.483640:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1787384563.484064:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1787384563.484226:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787384563.514297:0:14155:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787384563.514883:0:14155:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787384563.515163:0:14213:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787384563.515237:0:14213:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:0.0:1787384563.518936:0:14155:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787384563.519083:0:14155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787384563.520618:0:14212:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787384563.520625:0:14212:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000004:00000080:0.0:1787384563.520958:0:14155:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787384563.520970:0:14155:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787384563.521194:0:14155:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384563.521586:0:14213:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787384563.521654:0:14213:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787384563.521657:0:14213:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:00080000:0.0:1787384563.522964:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787384563.523590:0:14155:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787384563.523622:0:14155:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787384563.525530:0:14155:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787384563.531281:0:14155:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1787384563.564549:0:14155:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787384563.564585:0:14155:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb1ec817f7988 00100000:10000000:2.0:1787384563.564594:0:14155:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1787384563.565144:0:14155:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787384563.565159:0:14155:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787384563.565172:0:14155:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1787384563.565197:0:14155:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1787384564.042194:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787384564.297827:0:14170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787384564.297834:0:14170:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89e372969000 from 6 10000000:01000000:0.0:1787384564.297839:0:14170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787384564.297914:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384564.297924:0:14170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384564.297934:0:14170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384564.297960:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195962496:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384564.298023:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384564.298069:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34411f6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384564.308758:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195962496 00000100:00100000:2.0:1787384564.308781:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195962496 00000100:00100000:2.0:1787384564.308927:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787384564.308954:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14170:x1874208195962496:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384564.308971:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384564.308990:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e379eb3800/0x3522fbed3b6c446d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c4466 expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384564.309019:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e379eb3800/0x3522fbed3b6c446d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c4466 expref: 12 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384564.309031:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e379eb3800/0x3522fbed3b6c446d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4466 expref: 12 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384564.309039:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3800, rc 0) 00000100:00100000:2.0:1787384564.309131:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14170:x1874208195962496:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 166us (11095us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384564.309138:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787384564.314934:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195962496:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384564.314964:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384564.314977:0:14170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384564.315065:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195962624:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787384564.315279:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384564.315330:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e35077ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384564.315462:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195962624 00000100:00100000:0.0:1787384564.315469:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195962624 00000100:00100000:0.0:1787384564.315589:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787384564.315597:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14170:x1874208195962624:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1787384564.315618:0:14168:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787384564.315635:0:14168:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787384564.315643:0:14168:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1787384564.315722:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14170:x1874208195962624:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384564.315730:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787384564.316217:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195962624:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1787384564.316685:0:14170:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787384564.316695:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384564.316717:0:14170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384564.490546:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787384565.071314:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787384565.513499:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787384566.093451:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384567.116163:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384568.144427:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787384568.339475:0:14456:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1787384568.907837:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384568.907844:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384568.907847:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384568.907850:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1787384568.907852:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1787384568.907855:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1787384568.907892:0:36:0:(import.c:65:import_set_state_nolock()) ffff89e3450e8800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787384568.907904:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff89e3450e8800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1787384568.907926:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37315ed80 x1874208195962880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384568.907984:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384568.907998:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3307:1874208195962752:0@lo:400:kworker.0 00000100:00100000:1.0:1787384568.908096:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384568.908151:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195962752 00000100:00100000:1.0:1787384568.908158:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195962752 00000100:00100000:1.0:1787384568.908197:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384568.908205:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:3307:x1874208195962752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384568.908250:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:3307:x1874208195962752:12345-0@lo:400:kworker.0 Request processed in 45us (154us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384568.908257:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787384568.908316:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3307:1874208195962752:0@lo:400:kworker.0 00000100:00100000:1.0:1787384568.908339:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874208195962880:0@lo:38:kworker.0 00000100:00100000:1.0:1787384568.913955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384568.917997:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195962880 00000100:00100000:3.0:1787384568.918010:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195962880 00000100:00100000:3.0:1787384568.919508:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384568.919519:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3303:x1874208195962880:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1787384568.919547:0:14175:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 430 last 0 00000020:00000080:3.0:1787384568.919582:0:14175:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x3522fbed3b6c4474 00000004:00100000:3.0:1787384568.919598:0:14175:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787384568.919717:0:14175:0:(import.c:65:import_set_state_nolock()) ffff89e37c663800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384568.919802:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1874208195962880:12345-0@lo:38:kworker.0 Request processed in 283us (5854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384568.919809:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787384568.920570:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e37315ed80 x1874208195962880/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787384568.920589:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1787384568.920597:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1787384568.920603:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1787384568.920605:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e3450e8800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1787384568.920612:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3303:1874208195962880:0@lo:38:kworker.0 00010000:00010000:1.0:1787384569.162157:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384570.188216:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384571.211981:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787384571.547693:0:14606:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007ffd1537a4f0 00000020:00000080:3.0:1787384571.547712:0:14606:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:3.0:1787384571.547727:0:14606:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:3.0:1787384571.547740:0:14606:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd1537c780 20000000:00000080:3.0:1787384571.547748:0:14606:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e37a879400 uarg=0000000000000000 20000000:01000000:3.0:1787384571.547787:0:14606:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1787384571.547793:0:14606:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1787384571.547798:0:14606:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1787384571.551095:0:14607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787384571.551439:0:14606:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787384571.562022:0:14606:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787384571.562053:0:14606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384571.562070:0:14606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c443c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4435 expref: 11 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384571.562092:0:14606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384571.562133:0:14606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c443c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c4435 expref: 11 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384571.562148:0:14606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c443c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c4435 expref: 11 pid: 14168 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384571.562162:0:14606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14606:1874208195963008:0@lo:104: 00000100:00100000:3.0:1787384571.562221:0:14606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384571.562281:0:14606:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34411fcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384571.562351:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195963008 00000100:00100000:2.0:1787384571.562359:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195963008 00000100:00100000:2.0:1787384571.562407:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384571.562416:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+3:14606:x1874208195963008:12345-0@lo:104: 00010000:00010000:2.0:1787384571.562429:0:14157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384571.562484:0:14157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384571.562490:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+3:14606:x1874208195963008:12345-0@lo:104: Request processed in 76us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384571.562497:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787384571.562624:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384571.562632:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384571.562640:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031000 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384571.562644:0:14161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384571.562652:0:14161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384571.562658:0:14161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384571.562663:0:14161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384571.562700:0:14161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384571.562706:0:14161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384571.562737:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384571.562743:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c4435 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c443c expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384571.562768:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384571.562769:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384571.562771:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384571.562854:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3307:1874208195963136:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384571.562924:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384571.563001:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195963136 00000100:00100000:1.0:1787384571.563006:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195963136 00010000:00010000:1.0:1787384571.563033:0:14158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c443c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c4435 expref: 12 pid: 14168 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384571.563063:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384571.563070:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:3307:x1874208195963136:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384571.563081:0:14158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384571.563086:0:14158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c443c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c4435 expref: 12 pid: 14168 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563096:0:14158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c443c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c4435 expref: 12 pid: 14168 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563111:0:14158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563118:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563131:0:14158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563138:0:14158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563144:0:14158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563151:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563157:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384571.563161:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563175:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563183:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384571.563193:0:14158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384571.563228:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:3307:x1874208195963136:12345-0@lo:103:ldlm_bl.0 Request processed in 158us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384571.563235:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384571.563281:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3307:1874208195963136:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787384571.564229:0:14606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c443c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c4435 expref: 11 pid: 14168 timeout: 532 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384571.564244:0:14606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14606:1874208195963008:0@lo:104: 00010000:00010000:3.0:1787384571.564263:0:14606:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384571.564271:0:14606:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384571.564277:0:14606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384571.564283:0:14606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340030200/0x3522fbed3b6c447b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384572.234906:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384573.001241:0:3303:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384563/real 1787384563] req@ffff89e37315c000 x1874208195960192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384573 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787384573.001279:0:14170:0:(mgc_request.c:611:do_requeue()) updating log params 00000100:00100000:1.0:1787384573.001283:0:3303:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e37315c000 x1874208195960192/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384573 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384573.001292:0:3303:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384563/real 1787384563] req@ffff89e37315dc00 x1874208195960064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384573 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787384573.001302:0:14170:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e372969000 from 10 00000100:00100000:1.0:1787384573.001302:0:3303:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e37315dc00 x1874208195960064/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384573 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1787384573.001306:0:14170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00000100:00080000:1.0:1787384573.001319:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e349ebd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384573.001337:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787384573.001341:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195960192:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787384573.001346:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e372b98000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787384573.001350:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00010000:00010000:3.0:1787384573.001358:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384573.001359:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195960064:0@lo:8:llog_process_th.0 00010000:00010000:3.0:1787384573.001367:0:14170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384573.001377:0:14170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384573.001397:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195963264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787384573.001468:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384573.001525:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34411f600 going to sleep for 11 seconds 00000100:00080000:2.0:1787384573.001585:0:11859:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384573.001591:0:11859:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787384573.001594:0:11859:0:(import.c:65:import_set_state_nolock()) ffff89e372b98000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384573.001599:0:11859:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:2.0:1787384573.001604:0:11859:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787384573.001609:0:11859:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e372b98000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1787384573.001632:0:11859:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e241332d80 x1874208195963392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384573.001654:0:11859:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384573.001658:0:11859:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787384573.001660:0:11859:0:(import.c:65:import_set_state_nolock()) ffff89e349ebd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787384573.001663:0:11859:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 424 00000100:00080000:2.0:1787384573.001666:0:11859:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787384573.001669:0:11859:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e349ebd800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1787384573.001680:0:11859:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e241333100 x1874208195963520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787384573.001742:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195963264 00000100:00100000:1.0:1787384573.001753:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195963264 00000100:00100000:1.0:1787384573.001806:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384573.001814:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+11:14170:x1874208195963264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384573.001827:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384573.001841:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c4489 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c4482 expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384573.001885:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c4489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c4482 expref: 12 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384573.001895:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c4489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4482 expref: 12 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384573.001903:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d200, rc 0) 00000100:00100000:1.0:1787384573.001944:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14170:x1874208195963264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384573.001950:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1787384573.001999:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195963264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384573.002015:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384573.002025:0:14170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384573.002081:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195963776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384573.002118:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384573.002147:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347acf600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384573.002161:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195963776 00000100:00100000:1.0:1787384573.002164:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195963776 00000100:00100000:1.0:1787384573.002202:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787384573.002208:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14170:x1874208195963776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384573.002593:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14170:x1874208195963776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 384us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384573.002600:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787384573.002636:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195963776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384573.002664:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195963904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384573.002698:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384573.002723:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347acf600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384573.002734:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195963904 00000100:00100000:1.0:1787384573.002737:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195963904 00000100:00100000:1.0:1787384573.002755:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787384573.002761:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14170:x1874208195963904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384573.002912:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14170:x1874208195963904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 150us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384573.002919:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787384573.002956:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315dc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195963904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384573.003033:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195963648:0@lo:400:kworker.0 00000100:00100000:0.0:1787384573.003065:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384573.003094:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195963392:0@lo:8:kworker.0 00000400:00000100:3.0:1787384573.003123:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208195963392 offset 0 length 520: 4 00000100:00100000:3.0:1787384573.003140:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195963520:0@lo:8:kworker.0 00000400:00000100:3.0:1787384573.003155:0:3303:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874208195963520 offset 0 length 520: 4 00000100:00100000:2.0:1787384573.003228:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195963648 00000100:00100000:2.0:1787384573.003233:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195963648 00000100:00100000:2.0:1787384573.003279:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384573.003286:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195963648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384573.003334:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373149500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195963648:12345-0@lo:400:kworker.0 Request processed in 49us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384573.003341:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787384573.004072:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e241331c00 x1874208195963648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384589 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384573.004084:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195963648:0@lo:400:kworker.0 00000040:00080000:1.0:1787384573.007045:0:14668:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787384573.007447:0:14170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787384573.007471:0:14170:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384573.007483:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384573.007495:0:14170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384573.258909:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384574.281038:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384575.307051:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787384575.774156:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1787384576.198919:0:14807:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787384576.198923:0:14807:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1787384576.199050:0:14807:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89e379ff1000 00000020:01000004:0.0:1787384576.199066:0:14807:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787384576.199078:0:14807:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1787384576.199092:0:14807:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff89e37b3e0000) 00000020:00000080:0.0:1787384576.199110:0:14807:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1787384576.220146:0:14807:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1787384576.220441:0:14807:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1787384576.222354:0:14807:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1787384576.222650:0:14807:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:1.0:1787384576.223360:0:14807:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1787384576.223962:0:14807:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 689: rc = 0 00100000:10000000:1.0:1787384576.224199:0:14807:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 689: rc = 0 00100000:10000000:1.0:1787384576.224296:0:14807:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 689: rc = 0 00100000:10000000:1.0:1787384576.224971:0:14807:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 830: rc = 0 00100000:10000000:1.0:1787384576.225903:0:14807:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 830: rc = 0 00100000:10000000:1.0:1787384576.226342:0:14807:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 830: rc = 0 00100000:10000000:1.0:1787384576.227183:0:14807:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 830: rc = 0 00100000:10000000:1.0:1787384576.227448:0:14807:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 830: rc = 0 00100000:10000000:1.0:1787384576.228251:0:14807:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 830: rc = 0 00000020:00000080:1.0:1787384576.229400:0:14807:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:1.0:1787384576.229409:0:14807:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1787384576.229417:0:14807:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3522fbed3b6c4497 00000020:01000004:1.0:1787384576.229422:0:14807:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:1.0:1787384576.229438:0:14807:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1787384576.229441:0:14807:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1787384576.229446:0:14807:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:1.0:1787384576.229449:0:14807:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:1.0:1787384576.229458:0:14807:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff89e37b273380) 00000020:00000080:1.0:1787384576.229464:0:14807:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1787384576.231660:0:14807:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384576.231845:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1787384576.231852:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787384576.234342:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787384576.234354:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1787384576.237327:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1787384576.237342:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1787384576.244468:0:14807:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384576.244804:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1787384576.244810:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1787384576.245801:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1787384576.245812:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787384576.263509:0:14807:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787384576.263753:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787384576.263768:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787384576.265202:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787384576.265215:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787384576.267217:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787384576.267228:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1787384576.269321:0:14807:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787384576.269491:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1787384576.269497:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1787384576.272366:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1787384576.272380:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1787384576.305367:0:14807:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787384576.305559:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1787384576.305566:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1787384576.307051:0:14807:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1787384576.307064:0:14807:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787384576.307482:0:14807:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787384576.307505:0:14807:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787384576.307511:0:14807:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787384576.323303:0:14807:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787384576.323343:0:14807:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.151@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1787384576.323347:0:14807:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787384576.323349:0:14807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384576.323354:0:14807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384576.323355:0:14807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384576.323356:0:14807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384576.323357:0:14807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384576.323359:0:14807:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384576.323360:0:14807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384576.323361:0:14807:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384576.323365:0:14807:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1787384576.323367:0:14807:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787384576.323368:0:14807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384576.323369:0:14807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384576.323370:0:14807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384576.323370:0:14807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384576.323371:0:14807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384576.323372:0:14807:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384576.323373:0:14807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384576.323374:0:14807:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787384576.323399:0:14807:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787384576.323419:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964032:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787384576.323484:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.323661:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384576.323828:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195964032 00000100:00100000:1.0:1787384576.323836:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195964032 00000100:00100000:1.0:1787384576.324154:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787384576.324164:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14807:x1874208195964032:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787384576.324195:0:14165:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1787384576.324198:0:14165:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1787384576.324202:0:14165:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:1.0:1787384576.330320:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384576.334775:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14807:x1874208195964032:12345-0@lo:253:mount.lustre.0 Request processed in 10598us (11275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384576.334794:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787384576.334921:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964032:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787384576.334942:0:14807:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1787384576.334946:0:14807:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384576.334948:0:14807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1787384576.334949:0:14807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384576.334950:0:14807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384576.334952:0:14807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384576.334953:0:14807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384576.334955:0:14807:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384576.334957:0:14807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384576.334959:0:14807:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787384576.334996:0:14807:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e379ff1000 from lustre-OST0000 10000000:01000000:3.0:1787384576.335033:0:14807:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1787384576.335037:0:14807:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787384576.335046:0:14807:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e351f64d40 local copy 00010000:00010000:3.0:1787384576.335061:0:14807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4394 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384576.335365:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964160:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384576.335409:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384576.335451:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e35077e840 going to sleep for 11 seconds 00000100:00100000:2.0:1787384576.335995:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195964160 00000100:00100000:2.0:1787384576.336011:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195964160 00000100:00100000:2.0:1787384576.336086:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787384576.336102:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14807:x1874208195964160:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384576.336392:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14807:x1874208195964160:12345-0@lo:501:mount.lustre.0 Request processed in 295us (982us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787384576.336400:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787384576.336821:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964160:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787384576.336847:0:14807:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1787384576.337397:0:14807:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1787384576.337409:0:14807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4394 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.337435:0:14807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4394 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384576.337467:0:14807:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e379ff1000 10000000:01000000:3.0:1787384576.337472:0:14807:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787384576.337479:0:14807:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff89e351f64d40 10000000:01000000:3.0:1787384576.337482:0:14807:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1787384576.337486:0:14807:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff89e351f64d40 from 1 10000000:01000000:3.0:1787384576.337490:0:14807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1787384576.337534:0:14807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c44a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.337543:0:14807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c44a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.337555:0:14807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c44a5 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384576.337578:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964288:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384576.337639:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384576.337742:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e35077e840 going to sleep for 11 seconds 00000100:00100000:0.0:1787384576.338907:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195964288 00000100:00100000:0.0:1787384576.338921:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195964288 00000100:00100000:0.0:1787384576.338991:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787384576.339003:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+12:14807:x1874208195964288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384576.339029:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384576.339052:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108a200/0x3522fbed3b6c44ac lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c44a5 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.339085:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108a200/0x3522fbed3b6c44ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c44a5 expref: 13 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.339117:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108a200/0x3522fbed3b6c44ac lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c44a5 expref: 13 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.339128:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a200, rc 0) 00000100:00100000:0.0:1787384576.339462:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+13:14807:x1874208195964288:12345-0@lo:101:mount.lustre.0 Request processed in 460us (1821us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384576.339483:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787384576.339654:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964288:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384576.339677:0:14807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c44a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44ac expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.339699:0:14807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c44a5 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c44ac expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384576.339739:0:14807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1787384576.339759:0:14807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c44a5 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44ac expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.339767:0:14807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340030200/0x3522fbed3b6c44a5 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44ac expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384576.339779:0:14807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1787384576.339786:0:14807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787384576.339794:0:14807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1787384576.339797:0:14807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787384576.339827:0:14807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c44b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.339836:0:14807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c44b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.339844:0:14807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c44b3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384576.339963:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964416:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384576.340008:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384576.340053:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e35077e840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384576.340079:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195964416 00000100:00100000:1.0:1787384576.340095:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195964416 00000100:00100000:1.0:1787384576.340163:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787384576.340177:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+13:14807:x1874208195964416:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384576.340195:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384576.340213:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c44ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c44b3 expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.340239:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c44ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c44b3 expref: 14 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.340251:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624d400/0x3522fbed3b6c44ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c44b3 expref: 14 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.340260:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d400, rc 0) 00000100:00100000:1.0:1787384576.340334:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+14:14807:x1874208195964416:12345-0@lo:101:mount.lustre.0 Request processed in 162us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384576.340341:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787384576.340599:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964416:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384576.340616:0:14807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c44b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44ba expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.340625:0:14807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c44b3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c44ba expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384576.344641:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1787384576.346162:0:14807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384576.346480:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1787384576.346529:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1787384576.346990:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1787384576.347049:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1787384576.347088:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1787384576.347134:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1787384576.347211:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1787384576.347220:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1787384576.347310:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384576.347377:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384576.347495:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351279e40 going to sleep for 11 seconds 00000100:00100000:0.0:1787384576.348906:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195964544 00000100:00100000:0.0:1787384576.348919:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195964544 00000100:00100000:1.0:1787384576.349167:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787384576.349179:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+14:14807:x1874208195964544:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384576.349768:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+14:14807:x1874208195964544:12345-0@lo:501:mount.lustre.0 Request processed in 591us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384576.349777:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787384576.350075:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964544:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384576.350125:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964672:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384576.350176:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384576.350251:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351279e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384576.350377:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195964672 00000100:00100000:1.0:1787384576.350383:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195964672 00000100:00100000:1.0:1787384576.350457:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787384576.350466:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+14:14807:x1874208195964672:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384576.350785:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+14:14807:x1874208195964672:12345-0@lo:503:mount.lustre.0 Request processed in 319us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384576.350802:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1787384576.350904:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964672:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787384576.351436:0:14807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384576.351506:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964800:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384576.351560:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.352015:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384576.352071:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195964800 00000100:00100000:2.0:1787384576.352078:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195964800 00000100:00100000:2.0:1787384576.352179:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787384576.352189:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+14:14807:x1874208195964800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384576.352845:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+14:14807:x1874208195964800:12345-0@lo:502:mount.lustre.0 Request processed in 654us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384576.352855:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787384576.359288:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964800:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384576.359639:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787384576.359714:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787384576.359752:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787384576.360300:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787384576.360353:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787384576.360390:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787384576.360444:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787384576.360482:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787384576.360515:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1787384576.360559:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1787384576.360617:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1787384576.360667:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1787384576.361140:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964928:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384576.361224:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.361277:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384576.363267:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195964928 00000100:00100000:1.0:1787384576.363279:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195964928 00000100:00100000:1.0:1787384576.363339:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787384576.363347:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+14:14807:x1874208195964928:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384576.363573:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+14:14807:x1874208195964928:12345-0@lo:502:mount.lustre.0 Request processed in 226us (2349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384576.363581:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787384576.364094:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195964928:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384576.364201:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1787384576.364214:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1787384576.365543:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787384576.365553:0:14821:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1787384576.365559:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384576.365562:0:14821:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1787384576.365568:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787384576.365584:0:14821:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff89e3741a19c0) 00000020:00000080:3.0:1787384576.365603:0:14821:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787384576.365621:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787384576.365712:0:14821:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e379ff1000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1787384576.365721:0:14821:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787384576.365728:0:14821:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x3522fbed3b6c44c8 00010000:00010000:2.0:1787384576.373403:0:14821:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1787384576.374410:0:14821:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1787384576.378727:0:14821:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:1.0:1787384576.380834:0:14821:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1787384576.380845:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384576.380853:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384576.380855:0:14821:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1787384576.380905:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787384576.380908:0:14821:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787384576.380910:0:14821:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787384576.380911:0:14821:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787384576.380913:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787384576.380925:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384576.380927:0:14821:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787384576.380929:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384576.380933:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384576.380934:0:14821:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787384576.380937:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787384576.380938:0:14821:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787384576.380940:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384576.380942:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384576.380944:0:14821:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787384576.380946:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787384576.380948:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384576.380949:0:14821:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787384576.380952:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1787384576.381029:0:14821:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787384576.381033:0:14821:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787384576.381035:0:14821:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787384576.381047:0:14821:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1787384576.381108:0:14807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1787384576.381143:0:14807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787384576.381171:0:14807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c44b3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44ba expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.381182:0:14807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031000/0x3522fbed3b6c44b3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44ba expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384576.381190:0:14807:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e379ff1000 from 1 10000000:01000000:0.0:1787384576.381193:0:14807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787384576.381227:0:14807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.381235:0:14807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.381245:0:14807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384576.381268:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965056:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787384576.381334:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.381367:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384576.382265:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195965056 00000100:00100000:3.0:1787384576.382274:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195965056 00000100:00100000:3.0:1787384576.382327:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787384576.382336:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+14:14807:x1874208195965056:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384576.382351:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384576.382378:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340031400/0x3522fbed3b6c44d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c44cf expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.382402:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340031400/0x3522fbed3b6c44d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c44cf expref: 15 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.382413:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340031400/0x3522fbed3b6c44d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c44cf expref: 15 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.382422:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340031400, rc 0) 00000100:00100000:3.0:1787384576.382479:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195965056:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1143us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384576.382496:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1787384576.382560:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965056:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384576.382582:0:14807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.382592:0:14807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384576.383112:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1787384576.383717:0:14807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384576.383994:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1787384576.384041:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1787384576.384107:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1787384576.384115:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1787384576.384194:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384576.384244:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.384285:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384576.385826:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195965184 00000100:00100000:2.0:1787384576.385837:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195965184 00000100:00100000:2.0:1787384576.385913:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1787384576.385925:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195965184:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384576.386340:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195965184:12345-0@lo:501:mount.lustre.0 Request processed in 416us (2093us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384576.386348:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787384576.386395:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965184:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384576.386440:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965312:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384576.386486:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.386551:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384576.387128:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195965312 00000100:00100000:1.0:1787384576.387199:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195965312 00000100:00100000:1.0:1787384576.387237:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787384576.387245:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195965312:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384576.387461:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195965312:12345-0@lo:503:mount.lustre.0 Request processed in 216us (973us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384576.387468:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787384576.387537:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965312:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787384576.396988:0:14807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384576.397085:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965440:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384576.397546:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384576.397600:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3455876c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384576.397691:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195965440 00000100:00100000:3.0:1787384576.397699:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195965440 00000100:00100000:3.0:1787384576.397750:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787384576.397760:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195965440:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384576.397997:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195965440:12345-0@lo:502:mount.lustre.0 Request processed in 237us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384576.398014:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787384576.398341:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965440:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384576.398617:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1787384576.398670:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1787384576.398734:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1787384576.398771:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1787384576.398802:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1787384576.398843:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1787384576.398924:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1787384576.398977:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1787384576.399012:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965568:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384576.399062:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.399091:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e240 going to sleep for 11 seconds 00000100:00100000:2.0:1787384576.399907:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195965568 00000100:00100000:2.0:1787384576.399915:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195965568 00000100:00100000:2.0:1787384576.399958:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787384576.399967:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195965568:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384576.400322:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195965568:12345-0@lo:502:mount.lustre.0 Request processed in 355us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384576.400330:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787384576.400498:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965568:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384576.400624:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1787384576.400637:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787384576.401588:0:14825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384576.401621:0:14825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384576.401624:0:14825:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787384576.401631:0:14825:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e379ff1000 00000020:00000080:3.0:1787384576.401634:0:14825:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384576.401648:0:14825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384576.401651:0:14825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384576.401652:0:14825:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787384576.401654:0:14825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384576.401657:0:14825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384576.401658:0:14825:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787384576.401661:0:14825:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e379ff1000 00000020:00000080:3.0:1787384576.401662:0:14825:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384576.401724:0:14825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384576.401728:0:14825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384576.401729:0:14825:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787384576.401731:0:14825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787384576.401733:0:14825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384576.401735:0:14825:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787384576.401738:0:14825:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e379ff1000 00000020:00000080:3.0:1787384576.401739:0:14825:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787384576.401847:0:14825:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787384576.405277:0:14825:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787384576.405287:0:14825:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787384576.405297:0:14825:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1787384576.406249:0:14807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787384576.406284:0:14807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384576.406305:0:14807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.406317:0:14807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384576.406367:0:14807:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787384576.406370:0:14807:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e379ff1000 10000000:01000000:0.0:1787384576.406373:0:14807:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e379ff1000 10000000:01000000:0.0:1787384576.406377:0:14807:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787384576.406384:0:14807:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e379ff1000 from 1 10000000:01000000:0.0:1787384576.406386:0:14807:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787384576.406422:0:14807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c44dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.406430:0:14807:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c44dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.406441:0:14807:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c44dd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384576.406484:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787384576.406561:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.406595:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:3.0:1787384576.408521:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195965696 00000100:00100000:3.0:1787384576.408533:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195965696 00000100:00100000:3.0:1787384576.408584:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787384576.408594:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195965696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384576.408610:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384576.408628:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c44e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c44dd expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.408653:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c44e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c44dd expref: 16 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.408665:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e340030a00/0x3522fbed3b6c44e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c44dd expref: 16 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.408675:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e340030a00, rc 0) 00000100:00100000:3.0:1787384576.408749:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14807:x1874208195965696:12345-0@lo:101:mount.lustre.0 Request processed in 156us (2187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384576.408756:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787384576.409222:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384576.409239:0:14807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c44dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44e4 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384576.409249:0:14807:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c44dd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c44e4 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787384576.409840:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1787384576.410266:0:14807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787384576.410502:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1787384576.410548:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1787384576.410580:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1787384576.410637:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1787384576.410674:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1787384576.410735:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1787384576.410769:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1787384576.410801:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1787384576.411475:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1787384576.412123:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1787384576.412164:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1787384576.412225:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1787384576.412264:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1787384576.412300:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1787384576.412351:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1787384576.412388:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1787384576.412424:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1787384576.412497:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1787384576.412535:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1787384576.412569:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1787384576.412618:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1787384576.412652:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1787384576.412695:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1787384576.412749:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1787384576.412787:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1787384576.412841:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1787384576.416977:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1787384576.417241:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1787384576.417346:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1787384576.417355:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1787384576.417460:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384576.417526:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.417576:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384576.417769:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195965824 00000100:00100000:2.0:1787384576.417777:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195965824 00000100:00100000:2.0:1787384576.417823:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787384576.417833:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14807:x1874208195965824:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384576.419601:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14807:x1874208195965824:12345-0@lo:501:mount.lustre.0 Request processed in 1762us (2066us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384576.419612:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1787384576.420532:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965824:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384576.420583:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965952:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384576.420637:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.420676:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384576.421035:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195965952 00000100:00100000:2.0:1787384576.421114:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195965952 00000100:00100000:2.0:1787384576.421168:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787384576.421177:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14807:x1874208195965952:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384576.421343:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14807:x1874208195965952:12345-0@lo:503:mount.lustre.0 Request processed in 166us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384576.421350:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787384576.421463:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195965952:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1787384576.422175:0:14807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787384576.422245:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195966080:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384576.422294:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.422324:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384576.426349:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195966080 00000100:00100000:2.0:1787384576.426363:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195966080 00000100:00100000:2.0:1787384576.426412:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787384576.426422:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14807:x1874208195966080:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384576.426697:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14807:x1874208195966080:12345-0@lo:502:mount.lustre.0 Request processed in 277us (4402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384576.426706:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1787384576.426850:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195966080:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384576.427235:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1787384576.427297:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1787384576.427329:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1787384576.427382:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1787384576.427417:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1787384576.427464:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1787384576.427499:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1787384576.427531:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1787384576.427575:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1787384576.427624:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1787384576.427657:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1787384576.427719:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1787384576.427758:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1787384576.427795:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1787384576.427844:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1787384576.427910:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1787384576.427946:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1787384576.427995:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1787384576.428033:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1787384576.430266:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1787384576.430352:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1787384576.430389:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1787384576.430424:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1787384576.430471:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1787384576.430504:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1787384576.430558:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1787384576.430606:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1787384576.430641:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1787384576.430676:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1787384576.430738:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1787384576.430770:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1787384576.430799:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1787384576.430831:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1787384576.430920:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1787384576.430968:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1787384576.431025:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1787384576.431747:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1787384576.431788:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1787384576.431840:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1787384576.431903:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1787384576.431953:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195966208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384576.433113:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384576.433157:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c08e600 going to sleep for 11 seconds 00000100:00100000:0.0:1787384576.433159:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195966208 00000100:00100000:0.0:1787384576.433168:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195966208 00000100:00100000:0.0:1787384576.433256:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787384576.433266:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14807:x1874208195966208:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384576.433526:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14807:x1874208195966208:12345-0@lo:502:mount.lustre.0 Request processed in 261us (417us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384576.433533:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787384576.433616:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195966208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787384576.433720:0:14807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787384576.433737:0:14807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787384576.442642:0:14830:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787384576.442660:0:14830:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff89e37b3e19c0) 00000020:00000080:0.0:1787384576.442692:0:14830:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:0.0:1787384576.444639:0:14830:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e379ff1000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787384576.444651:0:14830:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e379ff1000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787384576.444655:0:14830:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e379ff1000 3 00010000:00080000:0.0:1787384576.444710:0:14830:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e37419b800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.151@tcp at head 00010000:00010000:0.0:1787384576.446769:0:14830:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:0.0:1787384576.448179:0:14830:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787384576.448234:0:14830:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787384576.448249:0:14830:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x3522fbed3b6c44f2 00000100:00080000:0.0:1787384576.448260:0:14830:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787384576.448267:0:14830:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff89e37419b800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1787384576.448304:0:14830:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e373148700 x1874208195966336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787384576.448348:0:14830:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787384576.448469:0:11859:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384576.448475:0:11859:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787384576.448478:0:11859:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787384576.448481:0:11859:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787384576.448530:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384576.448545:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195966464:0@lo:400:kworker.0 00000100:00100000:2.0:1787384576.448613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384576.448753:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874208195966336:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787384576.448785:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384576.448904:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195966464 00000100:00100000:2.0:1787384576.448912:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195966464 00000100:00100000:2.0:1787384576.448955:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195966336 00000100:00100000:2.0:1787384576.448959:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195966336 00000100:00100000:2.0:1787384576.448973:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384576.448982:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195966464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384576.449379:0:14175:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787384576.449388:0:14175:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787384576.449424:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241333b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195966464:12345-0@lo:400:kworker.0 Request processed in 59us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384576.449434:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787384576.449452:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384576.449457:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874208195966336:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787384576.449480:0:14174:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 437 last 0 00000020:00000080:2.0:1787384576.449512:0:14174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x3522fbed3b6c44f9 00000004:00100000:2.0:1787384576.449527:0:14174:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787384576.449556:0:14174:0:(import.c:65:import_set_state_nolock()) ffff89e372948800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384576.450564:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1874208195966336:12345-0@lo:38:llog_process_th.0 Request processed in 1101us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384576.450574:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787384576.450665:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e241331880 x1874208195966464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384592 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384576.450689:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195966464:0@lo:400:kworker.0 00000040:00080000:1.0:1787384576.451216:0:14830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:3.0:1787384576.451561:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff89e373148700 x1874208195966336/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384586 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384576.451572:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787384576.451580:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787384576.451595:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787384576.451600:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787384576.451603:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e37419b800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787384576.451610:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3303:1874208195966336:0@lo:38:llog_process_th.0 00000020:01000000:2.0:1787384576.453184:0:14807:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787384576.453224:0:14807:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787384576.453250:0:14807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c44dd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44e4 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384576.453262:0:14807:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e35108b600/0x3522fbed3b6c44dd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c44e4 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787384576.453376:0:14807:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787384576.453379:0:14807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384576.453381:0:14807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384576.453382:0:14807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384576.453383:0:14807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384576.453385:0:14807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384576.453386:0:14807:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384576.453388:0:14807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384576.453389:0:14807:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787384576.453393:0:14807:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1787384576.453395:0:14807:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787384576.453397:0:14807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787384576.453398:0:14807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787384576.453399:0:14807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787384576.453400:0:14807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787384576.453401:0:14807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787384576.453402:0:14807:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787384576.453403:0:14807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787384576.453404:0:14807:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787384576.453426:0:14807:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787384576.453446:0:14807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195966592:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787384576.453509:0:14807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384576.453552:0:14807:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e36626a240 going to sleep for 11 seconds 00000100:00100000:2.0:1787384576.455191:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195966592 00000100:00100000:2.0:1787384576.455205:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195966592 00000100:00100000:0.0:1787384576.455308:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787384576.455319:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14807:x1874208195966592:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787384576.455361:0:14165:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787384576.455376:0:14165:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787384576.486890:0:14165:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787384576.486905:0:14165:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1787384576.486936:0:14189:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787384576.486941:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787384576.486961:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384576.486979:0:14189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e379eb3800/0x3522fbed3b6c446d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4466 expref: 16 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384576.486988:0:14189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384576.487167:0:14189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e379eb3800/0x3522fbed3b6c446d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c4466 expref: 16 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384576.487181:0:14189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e379eb3800/0x3522fbed3b6c446d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c4466 expref: 16 pid: 14167 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384576.487196:0:14189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14189:1874208195966720:0@lo:104: 00000100:00100000:2.0:1787384576.487320:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384576.487432:0:14189:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3487ecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787384576.489397:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195966720 00000100:00100000:3.0:1787384576.489410:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195966720 00000100:00100000:3.0:1787384576.489455:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384576.489466:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+3:14189:x1874208195966720:12345-0@lo:104: 00010000:00010000:3.0:1787384576.489481:0:14157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.489567:0:14157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384576.489573:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+3:14189:x1874208195966720:12345-0@lo:104: Request processed in 110us (2253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384576.489580:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384576.489756:0:14189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14189:1874208195966720:0@lo:104: 00010000:00010000:2.0:1787384576.489780:0:14189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.489829:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384576.489835:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.489843:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108bc00 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:3.0:1787384576.489848:0:14161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.489856:0:14161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787384576.489889:0:14161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384576.489912:0:14161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787384576.489940:0:14161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.489947:0:14161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1787384576.489998:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3306:1874208195966848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384576.490044:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787384576.490095:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.490104:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e35108bc00/0x3522fbed3b6c4466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c446d expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384576.490121:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384576.490123:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384576.490124:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384576.490363:0:14160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195966848 00000100:00100000:1.0:1787384576.490368:0:14160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195966848 00010000:00010000:1.0:1787384576.490387:0:14160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e379eb3800/0x3522fbed3b6c446d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c4466 expref: 17 pid: 14167 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384576.490407:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384576.490413:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:3306:x1874208195966848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384576.490423:0:14160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384576.490428:0:14160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e379eb3800/0x3522fbed3b6c446d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c4466 expref: 17 pid: 14167 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490438:0:14160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e379eb3800/0x3522fbed3b6c446d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c4466 expref: 17 pid: 14167 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490453:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e379eb3800/0x3522fbed3b6c446d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c4466 expref: 17 pid: 14167 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490466:0:14160:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490474:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787384576.490489:0:14160:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007067332s 00010000:00010000:1.0:1787384576.490493:0:14160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490512:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490519:0:14160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490525:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490530:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384576.490534:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490542:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490556:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.490566:0:14160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384576.491447:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:3306:x1874208195966848:12345-0@lo:103:ldlm_bl.0 Request processed in 1029us (1398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384576.491457:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1787384576.491518:0:14189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.491527:0:14189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384576.491532:0:14189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e379eb3c00/0x3522fbed3b6c4500 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384576.492378:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3306:1874208195966848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384576.497495:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14807:x1874208195966592:12345-0@lo:253:mount.lustre.0 Request processed in 42169us (43975us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384576.497513:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787384576.497630:0:14807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14807:1874208195966592:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787384576.497645:0:14807:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787384576.497648:0:14807:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787384576.497650:0:14807:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787384576.497651:0:14807:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787384576.497653:0:14807:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787384576.497654:0:14807:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787384576.497656:0:14807:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787384576.497657:0:14807:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787384576.497659:0:14807:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787384576.497661:0:14807:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787384576.497677:0:14807:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787384576.504594:0:14807:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787384576.504780:0:14807:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787384576.504984:0:14807:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787384576.505483:0:14807:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787384576.505638:0:14807:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787384576.506656:0:14807:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1787384576.507702:0:14807:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1787384576.550578:0:14807:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1787384576.550586:0:14807:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1787384576.550617:0:14807:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787384576.550672:0:14807:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787384576.550700:0:14807:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1787384576.550727:0:14807:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:0.0:1787384577.354135:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1787384577.865848:0:14170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787384577.865856:0:14170:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89e372969000 from 7 10000000:01000000:0.0:1787384577.865885:0:14170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787384577.865930:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384577.865942:0:14170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384577.865953:0:14170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384577.865990:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195966976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384577.866055:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384577.866111:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e36626a240 going to sleep for 11 seconds 00000100:00100000:3.0:1787384577.866312:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195966976 00000100:00100000:3.0:1787384577.866320:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195966976 00000100:00100000:3.0:1787384577.866386:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787384577.866396:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+15:14170:x1874208195966976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384577.866411:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384577.866426:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e3413fc800/0x3522fbed3b6c450e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c4507 expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384577.866459:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e3413fc800/0x3522fbed3b6c450e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c4507 expref: 16 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384577.866470:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e3413fc800/0x3522fbed3b6c450e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4507 expref: 16 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384577.866479:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e3413fc800, rc 0) 00000100:00100000:3.0:1787384577.866538:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14170:x1874208195966976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384577.866545:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787384577.866687:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195966976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384577.866703:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384577.866712:0:14170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384577.866765:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195967104:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1787384577.866800:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384577.866981:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347acf000 going to sleep for 11 seconds 00000100:00100000:3.0:1787384577.867318:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195967104 00000100:00100000:3.0:1787384577.867324:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195967104 00000100:00100000:3.0:1787384577.867402:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787384577.867410:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14170:x1874208195967104:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787384577.867427:0:14165:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787384577.867443:0:14165:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787384577.867446:0:14165:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:3.0:1787384577.867554:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14170:x1874208195967104:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 145us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384577.867562:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787384577.867593:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195967104:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787384577.867640:0:14170:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787384577.867646:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384577.867653:0:14170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384578.377013:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384579.401040:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384580.429720:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384581.452191:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787384581.705237:0:11859:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384581.705244:0:11859:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1787384581.705247:0:11859:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384581.705250:0:11859:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787384581.705288:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195967360:0@lo:400:kworker.0 00000100:00100000:2.0:1787384581.705289:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3307:1874208195967232:0@lo:400:kworker.0 00000100:00100000:2.0:1787384581.710501:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384581.710622:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195967232 00000100:00100000:1.0:1787384581.710631:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195967232 00000100:00100000:1.0:1787384581.710686:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787384581.710695:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:3307:x1874208195967232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384581.710727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384581.710755:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:3307:x1874208195967232:12345-0@lo:400:kworker.0 Request processed in 61us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384581.710762:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787384581.710978:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195967488:0@lo:400:kworker.0 00000100:00100000:0.0:1787384581.711290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384581.711452:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3307:1874208195967232:0@lo:400:kworker.0 00000100:00100000:1.0:1787384581.711700:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195967360 00000100:00100000:1.0:1787384581.711705:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195967360 00000100:00100000:1.0:1787384581.711758:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195967488 00000100:00100000:1.0:1787384581.711761:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195967488 00000100:00100000:1.0:1787384581.711806:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384581.711813:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195967360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384581.711878:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373149880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195967360:12345-0@lo:400:kworker.0 Request processed in 63us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384581.711884:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787384581.711907:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384581.711915:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37314bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195967488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384581.711946:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37314bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195967488:12345-0@lo:400:kworker.0 Request processed in 32us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384581.711952:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1787384581.711981:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787384581.713049:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37314aa00 x1874208195967360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787384581.713065:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195967360:0@lo:400:kworker.0 00010000:00080000:0.0:1787384581.713366:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e373148380 x1874208195967488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384597 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384581.713378:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195967488:0@lo:400:kworker.0 00010000:00010000:1.0:1787384582.473045:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787384583.040665:0:15176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787384583.497496:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384584.521300:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384585.546772:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384585.995922:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787384586.577250:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787384586.826049:0:11859:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384586.826056:0:11859:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787384586.826059:0:11859:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384586.826061:0:11859:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787384586.826133:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3306:1874208195967616:0@lo:400:kworker.0 00000100:00100000:0.0:1787384586.826211:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384586.826278:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384586.826284:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195967744:0@lo:400:kworker.0 00000100:00100000:0.0:1787384586.826311:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384586.826337:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787384586.826345:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195967872:0@lo:400:kworker.0 00000100:00100000:0.0:1787384586.826367:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384586.826396:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195967744 00000100:00100000:0.0:1787384586.826403:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195967744 00000100:00100000:0.0:1787384586.826445:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195967872 00000100:00100000:0.0:1787384586.826448:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195967872 00000100:00100000:0.0:1787384586.826495:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384586.826504:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195967744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384586.826557:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373148380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195967744:12345-0@lo:400:kworker.0 Request processed in 54us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384586.826564:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384586.826582:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384586.826588:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37314aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195967872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384586.826630:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37314aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195967872:12345-0@lo:400:kworker.0 Request processed in 42us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384586.826636:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787384586.826658:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787384586.826686:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c4e5500 x1874208195967872/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384586.826699:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195967872:0@lo:400:kworker.0 00010000:00080000:0.0:1787384586.826721:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c4e4e00 x1874208195967744/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384602 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384586.826729:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195967744:0@lo:400:kworker.0 00000100:00100000:3.0:1787384586.826944:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195967616 00000100:00100000:3.0:1787384586.826949:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195967616 00000100:00100000:3.0:1787384586.826979:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787384586.826986:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:3306:x1874208195967616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384586.827022:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:3306:x1874208195967616:12345-0@lo:400:kworker.0 Request processed in 37us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384586.827028:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787384586.827189:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3306:1874208195967616:0@lo:400:kworker.0 00010000:00010000:0.0:1787384587.610765:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.617256:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384588.744986:0:3303:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384573/real 1787384573] req@ffff89e241332d80 x1874208195963392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384588 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384588.745014:0:3303:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e241332d80 x1874208195963392/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384588 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384588.745025:0:3303:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787384573/real 1787384573] req@ffff89e241333100 x1874208195963520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384588 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384588.745046:0:3303:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff89e241333100 x1874208195963520/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787384588 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787384588.745064:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e372b98000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787384588.745073:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787384588.745076:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195963392:0@lo:8:kworker.0 00000100:00080000:0.0:1787384588.745082:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e349ebd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787384588.745086:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1787384588.745089:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241333100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195963520:0@lo:8:kworker.0 00000100:00080000:3.0:1787384588.747754:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384588.747760:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1787384588.747763:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e372b98000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384588.747771:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:3.0:1787384588.747776:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787384588.747781:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff89e372b98000 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1787384588.747801:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37c4e7480 x1874208195968128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1787384588.747817:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787384588.747821:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787384588.747822:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e349ebd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787384588.747825:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 434 00000100:00080000:3.0:1787384588.747828:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1787384588.747832:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e349ebd800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:3.0:1787384588.747842:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37c4e4000 x1874208195968256/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787384588.747905:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3305:1874208195968000:0@lo:400:kworker.0 00000100:00100000:3.0:1787384588.747960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384588.748008:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195968384:0@lo:400:kworker.0 00000100:00100000:3.0:1787384588.748033:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384588.748049:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384588.748054:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195968512:0@lo:400:kworker.0 00000100:00100000:3.0:1787384588.748069:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384588.748092:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195968000 00000100:00100000:3.0:1787384588.748098:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195968000 00000100:00100000:3.0:1787384588.748144:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787384588.748347:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:3305:x1874208195968000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384588.748387:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:3305:x1874208195968000:12345-0@lo:400:kworker.0 Request processed in 43us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384588.748394:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787384588.748421:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195968384 00000100:00100000:3.0:1787384588.748424:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195968384 00000100:00100000:3.0:1787384588.748444:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195968512 00000100:00100000:3.0:1787384588.748446:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195968512 00000100:00100000:3.0:1787384588.748467:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384588.748472:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195968384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384588.748559:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195968384:12345-0@lo:400:kworker.0 Request processed in 86us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384588.748566:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384588.748578:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787384588.748584:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195968512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384588.748677:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195968512:12345-0@lo:400:kworker.0 Request processed in 94us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384588.748683:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:3.0:1787384588.748706:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787384588.748730:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c4e5f80 x1874208195968512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384588.748742:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195968512:0@lo:400:kworker.0 00010000:00080000:3.0:1787384588.748750:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c4e6d80 x1874208195968384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384604 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384588.748758:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195968384:0@lo:400:kworker.0 00000100:00100000:3.0:1787384588.748789:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3305:1874208195968000:0@lo:400:kworker.0 00000100:00100000:3.0:1787384588.748800:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195968128:0@lo:8:kworker.0 00000100:00100000:3.0:1787384588.748823:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384588.748840:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195968256:0@lo:8:kworker.0 00000100:00100000:3.0:1787384588.748856:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384588.749626:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195968128 00000100:00100000:0.0:1787384588.749634:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195968128 00000100:00100000:0.0:1787384588.749660:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195968256 00000100:00100000:0.0:1787384588.749663:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195968256 00000100:00100000:0.0:1787384588.749673:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384588.749679:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874208195968128:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787384588.749701:0:14809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:0.0:1787384588.749726:0:14809:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3522fbed3b6c4515 00002000:00100000:0.0:1787384588.749737:0:14809:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff89e374198000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1787384588.749740:0:14809:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1787384588.749743:0:14809:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787384588.750041:0:14809:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1787384588.750064:0:14809:0:(import.c:65:import_set_state_nolock()) ffff89e37419a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787384588.750116:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1874208195968128:12345-0@lo:8:kworker.0 Request processed in 436us (1291us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384588.750123:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384588.750146:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384588.750151:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874208195968256:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1787384588.750162:0:14809:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1787384588.750187:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874208195968256:12345-0@lo:8:kworker.0 Request processed in 35us (1329us total) trans 0 rc -19/-19 00000100:00100000:0.0:1787384588.750193:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787384588.763334:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37c4e7480 x1874208195968128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384608 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787384588.763350:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787384588.763360:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787384588.763369:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787384588.763376:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1787384588.763380:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e372b98000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787384588.763398:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787384588.763404:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195968128:0@lo:8:kworker.0 00000100:00080000:3.0:1787384588.763417:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e349ebd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1787384588.763421:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1787384588.763423:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195968256:0@lo:8:kworker.0 00000004:00080000:3.0:1787384588.763485:0:14196:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1787384588.763576:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14196:1874208195968768:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1787384588.763639:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384588.763664:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4a80 going to sleep for 11 seconds 00000004:00080000:3.0:1787384588.763679:0:14195:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787384588.763979:0:14195:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 449907118027ns, next at 0ns, rc = 0 00000100:00100000:3.0:1787384588.764009:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195968768 00000100:00100000:3.0:1787384588.764020:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195968768 00000100:00100000:3.0:1787384588.764069:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787384588.764077:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14196:x1874208195968768:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787384588.777603:0:14809:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1787384588.777615:0:14809:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1787384588.777620:0:14809:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:3.0:1787384588.791612:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195968640:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384588.791679:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787384588.791723:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1787384588.792273:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.792282:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e95f2ddd/0x3522fbed3b6c451c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.792298:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.792304:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.792311:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e95f2ddd/0x3522fbed3b6c451c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.792327:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e95f2ddd/0x3522fbed3b6c451c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.792337:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e95f2ddd/0x3522fbed3b6c451c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.792345:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e95f2ddd/0x3522fbed3b6c451c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.792373:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787384588.793915:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195968640 00000100:00100000:0.0:1787384588.793927:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195968640 00000100:00100000:0.0:1787384588.793971:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384588.793979:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874208195968640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384588.794012:0:14812:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384588.794094:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3304:x1874208195968640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (2414us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384588.794101:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1787384588.794152:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384588.794160:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e95f2ddd/0x3522fbed3b6c451c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.794173:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fc000 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384588.794178:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e95f2ddd/0x3522fbed3b6c451c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.794188:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e95f2ddd/0x3522fbed3b6c451c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.794208:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e95f2ddd/0x3522fbed3b6c451c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.794232:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e95f2ddd/0x3522fbed3b6c451c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.794253:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.794255:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.794257:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384588.796852:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195968640:0@lo:13:osp-pre-0-0.0 00002000:00010000:3.0:1787384588.797319:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.797329:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2787bf/0x3522fbed3b6c4523 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.797345:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.797349:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.797356:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d2787bf/0x3522fbed3b6c4523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.797370:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d2787bf/0x3522fbed3b6c4523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.797381:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d2787bf/0x3522fbed3b6c4523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.797389:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d2787bf/0x3522fbed3b6c4523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.797414:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384588.797427:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384588.797432:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d2787bf/0x3522fbed3b6c4523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.797452:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fca00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.797456:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2787bf/0x3522fbed3b6c4523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.797466:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d2787bf/0x3522fbed3b6c4523 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.797482:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d2787bf/0x3522fbed3b6c4523 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.797491:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d2787bf/0x3522fbed3b6c4523 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.797507:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.797509:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.797510:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.797987:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.797994:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a06432/0x3522fbed3b6c452a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798004:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.798007:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.798011:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a06432/0x3522fbed3b6c452a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798021:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2a06432/0x3522fbed3b6c452a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798034:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2a06432/0x3522fbed3b6c452a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798042:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2a06432/0x3522fbed3b6c452a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798057:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384588.798411:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.798417:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c4531 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798425:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.798428:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.798433:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c4531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798442:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c4531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798450:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c4531 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798458:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c4531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798482:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787384588.798493:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384588.798497:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2a06432/0x3522fbed3b6c452a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798505:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.798508:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a06432/0x3522fbed3b6c452a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798516:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2a06432/0x3522fbed3b6c452a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798527:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2a06432/0x3522fbed3b6c452a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798534:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2a06432/0x3522fbed3b6c452a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798547:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384588.798551:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c4531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798557:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd000 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.798560:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c4531 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798580:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c4531 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.798590:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c4531 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.800200:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce7bb8e6/0x3522fbed3b6c4531 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.800363:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.800366:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.800367:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.800944:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.800952:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d208af4/0x3522fbed3b6c4538 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.800964:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.800968:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.800973:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d208af4/0x3522fbed3b6c4538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.800985:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d208af4/0x3522fbed3b6c4538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.800994:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d208af4/0x3522fbed3b6c4538 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.801006:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d208af4/0x3522fbed3b6c4538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.801020:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384588.802101:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384588.802109:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d208af4/0x3522fbed3b6c4538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.802118:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384588.802123:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d208af4/0x3522fbed3b6c4538 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.802178:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.803004:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d208af4/0x3522fbed3b6c4538 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.803025:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d208af4/0x3522fbed3b6c4538 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.803033:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d208af4/0x3522fbed3b6c4538 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.803053:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.803055:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.803057:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.806698:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.806711:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c453f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.806728:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.806732:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.806737:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c453f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.806751:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c453f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.806762:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c453f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.806770:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c453f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.806796:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384588.806991:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384588.806999:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c453f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.807007:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fce00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384588.807011:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c453f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.807032:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c453f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.807051:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c453f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.807058:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ba1cc76/0x3522fbed3b6c453f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.807078:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384588.807080:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384588.807081:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.807638:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.807652:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026099e3c/0x3522fbed3b6c4546 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.807663:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.807666:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.807670:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026099e3c/0x3522fbed3b6c4546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.807680:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026099e3c/0x3522fbed3b6c4546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.807688:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026099e3c/0x3522fbed3b6c4546 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.807694:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026099e3c/0x3522fbed3b6c4546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.807709:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384588.807807:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384588.807814:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026099e3c/0x3522fbed3b6c4546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.807822:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fdc00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384588.807826:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026099e3c/0x3522fbed3b6c4546 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.807834:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026099e3c/0x3522fbed3b6c4546 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.807846:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026099e3c/0x3522fbed3b6c4546 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.807854:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026099e3c/0x3522fbed3b6c4546 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.807886:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.807888:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.807890:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.809408:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.809418:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c454d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.809432:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.809435:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.809441:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c454d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.809452:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c454d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.809467:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c454d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.809475:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c454d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.809493:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384588.809506:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384588.809512:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c454d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.809519:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e3413fd600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.809524:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c454d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.809533:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c454d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.809548:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c454d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.809556:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000883f9687/0x3522fbed3b6c454d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.809573:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.809579:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.809581:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.810732:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.810741:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000828a0823/0x3522fbed3b6c4554 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.810753:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.810757:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.810762:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000828a0823/0x3522fbed3b6c4554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.810772:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000828a0823/0x3522fbed3b6c4554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.810782:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000828a0823/0x3522fbed3b6c4554 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.810788:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000828a0823/0x3522fbed3b6c4554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.810807:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384588.810988:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384588.810995:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000828a0823/0x3522fbed3b6c4554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.811003:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340031200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384588.811007:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000828a0823/0x3522fbed3b6c4554 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.811028:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000828a0823/0x3522fbed3b6c4554 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.811043:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000828a0823/0x3522fbed3b6c4554 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.811049:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000828a0823/0x3522fbed3b6c4554 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.811064:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.811066:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.811067:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.815661:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.815672:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053a45d19/0x3522fbed3b6c455b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.815688:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.815693:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.815699:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053a45d19/0x3522fbed3b6c455b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.815719:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053a45d19/0x3522fbed3b6c455b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.815730:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053a45d19/0x3522fbed3b6c455b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.815739:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053a45d19/0x3522fbed3b6c455b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.815755:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384588.815766:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384588.815771:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053a45d19/0x3522fbed3b6c455b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.815778:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.815783:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053a45d19/0x3522fbed3b6c455b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.815792:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053a45d19/0x3522fbed3b6c455b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.815806:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053a45d19/0x3522fbed3b6c455b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.815813:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053a45d19/0x3522fbed3b6c455b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.815835:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.815837:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.815839:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384588.820094:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384588.820106:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c4562 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.820123:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1787384588.820139:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384588.820145:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c4562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.820160:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c4562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.820169:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c4562 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.820186:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c4562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.820205:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787384588.820793:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384588.820799:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c4569 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.820809:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1787384588.820812:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384588.820816:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c4569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.820824:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c4569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.820832:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c4569 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.820838:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c4569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.820855:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787384588.821242:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384588.821249:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c4562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.821259:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384588.821263:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c4562 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.821273:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c4562 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.821289:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c4562 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.821309:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c4562 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.821328:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384588.821332:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c4569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.821339:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384588.821343:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c4569 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.821351:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c4569 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.821360:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c4569 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.821368:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c4569 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.821378:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.821379:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.821381:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.825459:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.827293:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.827307:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000342c61fe/0x3522fbed3b6c4570 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.827324:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.827328:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.827334:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000342c61fe/0x3522fbed3b6c4570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.827348:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000342c61fe/0x3522fbed3b6c4570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.827358:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000342c61fe/0x3522fbed3b6c4570 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.827365:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000342c61fe/0x3522fbed3b6c4570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.827388:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384588.827417:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384588.827424:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000342c61fe/0x3522fbed3b6c4570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.827438:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677e00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384588.827443:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000342c61fe/0x3522fbed3b6c4570 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.827452:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000342c61fe/0x3522fbed3b6c4570 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.827469:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000342c61fe/0x3522fbed3b6c4570 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.827476:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000342c61fe/0x3522fbed3b6c4570 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.827494:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.827506:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.827508:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.827840:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.828967:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4577 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.828999:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.829003:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.829008:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.829020:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.829033:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4577 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.829039:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.829058:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384588.829272:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384588.829279:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.829288:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384588.829293:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4577 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.829301:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4577 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.829402:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4577 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.829411:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4577 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.829430:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.829432:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.829434:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.830575:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.830584:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072fe00e4/0x3522fbed3b6c457e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.830604:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.830609:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.830614:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000072fe00e4/0x3522fbed3b6c457e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.830626:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000072fe00e4/0x3522fbed3b6c457e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.830647:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000072fe00e4/0x3522fbed3b6c457e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.830654:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000072fe00e4/0x3522fbed3b6c457e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.830678:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384588.830894:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384588.830900:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000072fe00e4/0x3522fbed3b6c457e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.830908:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384588.830919:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000072fe00e4/0x3522fbed3b6c457e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.830928:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000072fe00e4/0x3522fbed3b6c457e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.830944:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000072fe00e4/0x3522fbed3b6c457e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.830951:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000072fe00e4/0x3522fbed3b6c457e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.830969:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.830971:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.830972:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.832484:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.832496:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010361ec9/0x3522fbed3b6c4585 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.832510:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.832514:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.832519:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000010361ec9/0x3522fbed3b6c4585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.832531:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000010361ec9/0x3522fbed3b6c4585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.832539:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000010361ec9/0x3522fbed3b6c4585 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.832547:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000010361ec9/0x3522fbed3b6c4585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.832576:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384588.833722:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.833732:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca368f12/0x3522fbed3b6c458c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.833744:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.833748:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.833752:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ca368f12/0x3522fbed3b6c458c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.833761:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ca368f12/0x3522fbed3b6c458c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.833768:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ca368f12/0x3522fbed3b6c458c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.833774:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ca368f12/0x3522fbed3b6c458c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.833796:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787384588.834820:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384588.834830:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000010361ec9/0x3522fbed3b6c4585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.834841:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384588.834846:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000010361ec9/0x3522fbed3b6c4585 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.834874:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000010361ec9/0x3522fbed3b6c4585 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.834893:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000010361ec9/0x3522fbed3b6c4585 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.834903:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000010361ec9/0x3522fbed3b6c4585 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.834934:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384588.834938:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ca368f12/0x3522fbed3b6c458c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.834943:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676e00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384588.834946:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca368f12/0x3522fbed3b6c458c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.834954:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ca368f12/0x3522fbed3b6c458c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.834964:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ca368f12/0x3522fbed3b6c458c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.834971:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca368f12/0x3522fbed3b6c458c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384588.834984:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.834986:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384588.834988:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.835305:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.837372:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.837384:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4593 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.837400:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.837408:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.837415:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.837428:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.837438:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4593 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.837446:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.837472:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384588.840181:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384588.840194:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.840207:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384588.840212:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4593 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.840223:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4593 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.840245:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4593 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.840263:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4593 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.840288:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.840290:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.840292:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.840727:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.840738:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082216dc5/0x3522fbed3b6c459a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.840749:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.840754:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.840761:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000082216dc5/0x3522fbed3b6c459a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.840773:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000082216dc5/0x3522fbed3b6c459a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.840782:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000082216dc5/0x3522fbed3b6c459a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.840797:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000082216dc5/0x3522fbed3b6c459a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.840820:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384588.841097:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384588.841102:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000082216dc5/0x3522fbed3b6c459a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.841110:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384588.841113:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000082216dc5/0x3522fbed3b6c459a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.841121:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000082216dc5/0x3522fbed3b6c459a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.841141:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000082216dc5/0x3522fbed3b6c459a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.841147:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000082216dc5/0x3522fbed3b6c459a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.841163:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.841165:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.841167:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.841559:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.841565:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e2441e0/0x3522fbed3b6c45a1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.841574:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.841577:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.841581:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e2441e0/0x3522fbed3b6c45a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.841591:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e2441e0/0x3522fbed3b6c45a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.841610:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e2441e0/0x3522fbed3b6c45a1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.841617:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e2441e0/0x3522fbed3b6c45a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.841637:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384588.841666:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384588.841671:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e2441e0/0x3522fbed3b6c45a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.841679:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384588.841682:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e2441e0/0x3522fbed3b6c45a1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.841691:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e2441e0/0x3522fbed3b6c45a1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.841702:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e2441e0/0x3522fbed3b6c45a1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.841709:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e2441e0/0x3522fbed3b6c45a1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.841722:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.841724:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.841725:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384588.842022:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.842028:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c45a8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842040:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.842043:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.842048:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c45a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842057:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c45a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842065:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c45a8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842073:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c45a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842091:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384588.842437:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384588.842443:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e2e6c8c/0x3522fbed3b6c45af lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842451:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=449s v=(0 0) 00010000:00010000:3.0:1787384588.842454:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384588.842458:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009e2e6c8c/0x3522fbed3b6c45af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842466:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009e2e6c8c/0x3522fbed3b6c45af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842485:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009e2e6c8c/0x3522fbed3b6c45af lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842492:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009e2e6c8c/0x3522fbed3b6c45af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842505:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787384588.842516:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384588.842519:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c45a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842526:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.842530:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c45a8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842537:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c45a8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842549:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c45a8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842556:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c45a8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842572:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384588.842582:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009e2e6c8c/0x3522fbed3b6c45af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.842588:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.842592:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009e2e6c8c/0x3522fbed3b6c45af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.842895:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.843500:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009e2e6c8c/0x3522fbed3b6c45af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.843516:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009e2e6c8c/0x3522fbed3b6c45af lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.843523:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009e2e6c8c/0x3522fbed3b6c45af lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.844685:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.844690:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.844692:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384588.845960:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384588.845972:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c45b6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.845994:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1787384588.845998:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384588.846004:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c45b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.846018:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c45b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.846027:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c45b6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.846036:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c45b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.846065:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384588.846182:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384588.846188:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c45b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.846196:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.846202:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c45b6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.846221:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c45b6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.846237:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c45b6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.846244:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009004d2fd/0x3522fbed3b6c45b6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.846263:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.846264:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.846266:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384588.846465:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384588.846471:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c45bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.846479:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1787384588.846483:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384588.846487:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c45bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.846568:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c45bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.846589:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c45bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.846604:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c45bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.846623:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384588.846656:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384588.846661:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c45bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.846669:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.846673:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c45bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.846681:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c45bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.846693:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c45bd lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.846710:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000235910d6/0x3522fbed3b6c45bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.846724:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.846726:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.846728:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384588.847015:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384588.847021:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67001ed/0x3522fbed3b6c45c4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.847030:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1787384588.847033:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384588.847037:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a67001ed/0x3522fbed3b6c45c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.847045:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a67001ed/0x3522fbed3b6c45c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.847053:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67001ed/0x3522fbed3b6c45c4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.847060:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a67001ed/0x3522fbed3b6c45c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.847085:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384588.847110:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384588.847115:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a67001ed/0x3522fbed3b6c45c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.847122:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.847125:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67001ed/0x3522fbed3b6c45c4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.847133:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67001ed/0x3522fbed3b6c45c4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.847144:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a67001ed/0x3522fbed3b6c45c4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.847151:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a67001ed/0x3522fbed3b6c45c4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.847163:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.847165:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.847167:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384588.847444:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384588.847450:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ee021d1/0x3522fbed3b6c45cb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.847461:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1787384588.847464:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384588.847468:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006ee021d1/0x3522fbed3b6c45cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.847477:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006ee021d1/0x3522fbed3b6c45cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.847485:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006ee021d1/0x3522fbed3b6c45cb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.847492:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006ee021d1/0x3522fbed3b6c45cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.848747:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384588.848893:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384588.848900:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006ee021d1/0x3522fbed3b6c45cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.848910:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.848915:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006ee021d1/0x3522fbed3b6c45cb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.848924:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006ee021d1/0x3522fbed3b6c45cb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.848940:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006ee021d1/0x3522fbed3b6c45cb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.848946:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006ee021d1/0x3522fbed3b6c45cb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.848966:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.848968:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.848969:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384588.849400:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384588.849406:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c45d2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.849417:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1787384588.849428:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384588.849433:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c45d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.849444:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c45d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.849453:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c45d2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.849460:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c45d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.849479:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384588.849987:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384588.849993:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c45d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.850002:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3a00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384588.850005:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c45d2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.850030:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c45d2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.850045:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c45d2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.850052:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c45d2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384588.850068:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.850069:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384588.850071:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384588.855573:0:14809:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384588.855587:0:14809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab409157/0x3522fbed3b6c45d9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.855613:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=449s v=(0 0) 00010000:00010000:2.0:1787384588.855617:0:14809:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384588.855623:0:14809:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab409157/0x3522fbed3b6c45d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.855638:0:14809:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab409157/0x3522fbed3b6c45d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.855647:0:14809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab409157/0x3522fbed3b6c45d9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.855661:0:14809:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab409157/0x3522fbed3b6c45d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384588.855718:0:14809:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:3.0:1787384588.856186:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1787384588.856272:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384588.856279:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab409157/0x3522fbed3b6c45d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.856287:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384588.856291:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab409157/0x3522fbed3b6c45d9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.856310:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab409157/0x3522fbed3b6c45d9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.856326:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab409157/0x3522fbed3b6c45d9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.856333:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab409157/0x3522fbed3b6c45d9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384588.856354:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.856355:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384588.856357:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787384588.856428:0:14809:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:2.0:1787384588.857092:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14196:x1874208195968768:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93011us (93448us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384588.857106:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384588.857249:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14196:1874208195968768:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787384588.857263:0:14196:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1787384588.857304:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14196:1874208195968896:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787384588.857417:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384588.857514:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34561e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384588.857620:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195968896 00000100:00100000:1.0:1787384588.857627:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195968896 00000100:00100000:1.0:1787384588.857701:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384588.857710:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37314a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14196:x1874208195968896:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1787384588.857749:0:14808:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1787384588.863531:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37314a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14196:x1874208195968896:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5814us (6106us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1787384588.863545:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384588.863748:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14196:1874208195968896:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787384588.863763:0:14196:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1787384589.646352:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384590.665361:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1787384590.862837:0:15479:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1787384590.863267:0:15479:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1787384590.863391:0:15479:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff89e37419f800 00000020:01000004:0.0:1787384590.863408:0:15479:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1787384590.863421:0:15479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1787384590.863435:0:15479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff89e37b3e3380) 00000020:00000080:0.0:1787384590.863469:0:15479:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787384590.884431:0:15479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787384590.884753:0:15479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787384590.887286:0:15479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787384590.887529:0:15479:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787384590.887752:0:15479:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787384590.888327:0:15479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 159: rc = 0 00100000:10000000:0.0:1787384590.888420:0:15479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 159: rc = 0 00100000:10000000:0.0:1787384590.888564:0:15479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 159: rc = 0 00100000:10000000:0.0:1787384590.893601:0:15479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 500: rc = 0 00100000:10000000:0.0:1787384590.894629:0:15479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 500: rc = 0 00100000:10000000:0.0:1787384590.895261:0:15479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 500: rc = 0 00100000:10000000:0.0:1787384590.895521:0:15479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 500: rc = 0 00100000:10000000:0.0:1787384590.895793:0:15479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 500: rc = 0 00100000:10000000:0.0:1787384590.896090:0:15479:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 500: rc = 0 00000020:00000080:0.0:1787384590.898322:0:15479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:0.0:1787384590.898336:0:15479:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787384590.898353:0:15479:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3522fbed3b6c45e7 00000020:01000004:0.0:1787384590.898361:0:15479:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:0.0:1787384590.898383:0:15479:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.151@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787384590.898386:0:15479:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.151@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787384590.898392:0:15479:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:0.0:1787384590.898411:0:15479:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:0.0:1787384590.898415:0:15479:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.151@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787384590.915551:0:15479:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.151@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787384590.915751:0:15479:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.151@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787384590.915756:0:15479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787384590.915758:0:15479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384590.915760:0:15479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384590.915761:0:15479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384590.915762:0:15479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384590.915763:0:15479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384590.915806:0:15479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384590.915808:0:15479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384590.915810:0:15479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384590.915813:0:15479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787384590.915815:0:15479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384590.915816:0:15479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384590.915817:0:15479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384590.915818:0:15479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384590.915826:0:15479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384590.915827:0:15479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384590.915828:0:15479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384590.915829:0:15479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384590.915829:0:15479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787384590.915854:0:15479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787384590.916069:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969024:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787384590.916135:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384590.916190:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37c294840 going to sleep for 11 seconds 00000100:00100000:1.0:1787384590.916205:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195969024 00000100:00100000:1.0:1787384590.916213:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195969024 00000100:00100000:1.0:1787384590.916261:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787384590.916270:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:15479:x1874208195969024:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787384590.916296:0:14167:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1787384590.916305:0:14167:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1787384590.916310:0:14167:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1787384590.923446:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:15479:x1874208195969024:12345-0@lo:253:mount.lustre.0 Request processed in 7166us (7299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384590.923459:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787384590.923572:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969024:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787384590.923598:0:15479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787384590.923601:0:15479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384590.923603:0:15479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384590.923604:0:15479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384590.923605:0:15479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384590.923606:0:15479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384590.923608:0:15479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384590.923609:0:15479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384590.923611:0:15479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384590.923612:0:15479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787384590.923633:0:15479:0:(tgt_mount.c:101:server_register_mount()) register mount ffff89e37419f800 from lustre-OST0001 10000000:01000000:3.0:1787384590.923678:0:15479:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787384590.923681:0:15479:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787384590.923688:0:15479:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff89e351f64d40 local copy 00010000:00010000:3.0:1787384590.923697:0:15479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4394 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384590.924284:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969152:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384590.924325:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384590.924355:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384590.924396:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195969152 00000100:00100000:0.0:1787384590.924416:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195969152 00000100:00100000:0.0:1787384590.924462:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787384590.924471:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:15479:x1874208195969152:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384590.924654:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:15479:x1874208195969152:12345-0@lo:501:mount.lustre.0 Request processed in 183us (327us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787384590.924662:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787384590.924920:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969152:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1787384590.924944:0:15479:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.151@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787384590.925367:0:15479:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.151@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787384590.925375:0:15479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4394 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.925387:0:15479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e340031a00/0x3522fbed3b6c438d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4394 expref: -99 pid: 14155 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384590.925408:0:15479:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff89e37419f800 10000000:01000000:2.0:1787384590.925412:0:15479:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787384590.925418:0:15479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787384590.925421:0:15479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384590.925425:0:15479:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787384590.925428:0:15479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787384590.925461:0:15479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb3600/0x3522fbed3b6c45ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.925470:0:15479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e379eb3600/0x3522fbed3b6c45ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.925479:0:15479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e379eb3600/0x3522fbed3b6c45ee lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384590.925494:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969280:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384590.925534:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384590.925568:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461cc6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787384590.925632:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195969280 00000100:00100000:1.0:1787384590.925638:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195969280 00000100:00100000:1.0:1787384590.925677:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787384590.925685:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:15479:x1874208195969280:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787384590.925695:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384590.925707:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c45f5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c45ee expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.925728:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c45f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c45ee expref: 17 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.925738:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624c800/0x3522fbed3b6c45f5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c45ee expref: 17 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384590.925746:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c800, rc 0) 00000100:00100000:1.0:1787384590.925786:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:15479:x1874208195969280:12345-0@lo:101:mount.lustre.0 Request processed in 102us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384590.925793:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787384590.926404:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969280:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384590.926420:0:15479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e379eb3600/0x3522fbed3b6c45ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c45f5 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.926429:0:15479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e379eb3600/0x3522fbed3b6c45ee lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c45f5 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384590.928723:0:15479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787384590.929666:0:15479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384590.929944:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787384590.930000:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787384590.930036:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787384590.930086:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787384590.930126:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787384590.930161:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787384590.930243:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787384590.930253:0:15479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787384590.930323:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384590.930389:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384590.930438:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384590.930639:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195969408 00000100:00100000:2.0:1787384590.930647:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195969408 00000100:00100000:2.0:1787384590.930699:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1787384590.930708:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:15479:x1874208195969408:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384590.931074:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:15479:x1874208195969408:12345-0@lo:501:mount.lustre.0 Request processed in 366us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384590.931081:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787384590.932474:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969408:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384590.932525:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969536:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384590.932597:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384590.932675:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f600 going to sleep for 11 seconds 00000100:00100000:1.0:1787384590.932715:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195969536 00000100:00100000:1.0:1787384590.932722:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195969536 00000100:00100000:1.0:1787384590.932814:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787384590.932823:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:15479:x1874208195969536:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384590.933479:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:15479:x1874208195969536:12345-0@lo:503:mount.lustre.0 Request processed in 654us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384590.933487:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787384590.933569:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969536:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787384590.934327:0:15479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787384590.934390:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969664:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384590.934437:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384590.937501:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384590.937602:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195969664 00000100:00100000:2.0:1787384590.937610:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195969664 00000100:00100000:3.0:1787384590.937842:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787384590.937853:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:15479:x1874208195969664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384590.938375:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374901850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:15479:x1874208195969664:12345-0@lo:502:mount.lustre.0 Request processed in 522us (3935us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384590.938383:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787384590.938479:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969664:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384590.938746:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1787384590.938801:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1787384590.938833:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1787384590.938910:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1787384590.938967:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1787384590.939001:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1787384590.939352:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1787384590.939394:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1787384590.939445:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1787384590.939483:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37314a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969792:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384590.939539:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384590.939795:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346bb4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787384590.940034:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195969792 00000100:00100000:1.0:1787384590.940042:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195969792 00000100:00100000:1.0:1787384590.940088:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787384590.940096:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:15479:x1874208195969792:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384590.940306:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374903050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:15479:x1874208195969792:12345-0@lo:502:mount.lustre.0 Request processed in 209us (766us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384590.940314:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787384590.940476:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37314a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969792:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1787384590.940556:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1787384590.940575:0:15479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787384590.941547:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787384590.941555:0:15481:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787384590.941561:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384590.941564:0:15481:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787384590.941570:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787384590.941592:0:15481:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff89e37b3e4d40) 00000020:00000080:0.0:1787384590.941612:0:15481:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787384590.941618:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787384590.941688:0:15481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e37419f800 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787384590.941695:0:15481:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787384590.941702:0:15481:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x3522fbed3b6c4603 00010000:00010000:0.0:1787384590.946446:0:15481:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1787384590.947195:0:15481:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1787384590.949921:0:15481:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787384590.951421:0:15481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787384590.951435:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384590.951443:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384590.951445:0:15481:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787384590.951449:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384590.951453:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384590.951455:0:15481:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787384590.951458:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787384590.951460:0:15481:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787384590.951462:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384590.951464:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384590.951465:0:15481:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787384590.951468:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787384590.951470:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384590.951471:0:15481:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787384590.951475:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787384590.951529:0:15481:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787384590.951532:0:15481:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787384590.951540:0:15481:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787384590.951543:0:15481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1787384590.951747:0:15479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1787384590.951778:0:15479:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1787384590.951806:0:15479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb3600/0x3522fbed3b6c45ee lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c45f5 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384590.951819:0:15479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e379eb3600/0x3522fbed3b6c45ee lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c45f5 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787384590.951827:0:15479:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e37419f800 from 1 10000000:01000000:3.0:1787384590.951830:0:15479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787384590.951888:0:15479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384590.951896:0:15479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384590.951907:0:15479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384590.951929:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969920:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787384590.952004:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384590.952053:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787384590.953026:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195969920 00000100:00100000:0.0:1787384590.953035:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195969920 00000100:00100000:0.0:1787384590.953087:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787384590.953098:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:15479:x1874208195969920:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787384590.953947:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384590.953968:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c4611 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c460a expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384590.953998:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c4611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c460a expref: 18 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384590.954010:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c4611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c460a expref: 18 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384590.954030:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108b200, rc 0) 00000100:00100000:0.0:1787384590.954105:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374900450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195969920:12345-0@lo:101:mount.lustre.0 Request processed in 1009us (2100us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384590.954322:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195969920:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787384590.954340:0:15479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384590.954349:0:15479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384590.954851:0:15479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1787384590.955368:0:15479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787384590.955623:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1787384590.955676:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1787384590.955735:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1787384590.955743:0:15479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1787384590.955802:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970048:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787384590.955855:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384590.955914:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f300 going to sleep for 11 seconds 00000100:00100000:0.0:1787384590.956029:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787384590.956062:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195970048 00000100:00100000:0.0:1787384590.956067:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195970048 00000100:00100000:0.0:1787384590.956099:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787384590.956106:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195970048:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384590.956408:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374902050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195970048:12345-0@lo:501:mount.lustre.0 Request processed in 301us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384590.956415:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787384590.956930:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970048:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384590.956989:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970176:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787384590.957044:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384590.957068:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3461cc000 going to sleep for 11 seconds 00000100:00100000:0.0:1787384590.957288:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195970176 00000100:00100000:0.0:1787384590.957294:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195970176 00000100:00100000:0.0:1787384590.957329:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1787384590.957336:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195970176:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787384590.957491:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374903850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195970176:12345-0@lo:503:mount.lustre.0 Request processed in 154us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384590.957498:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1787384590.957567:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970176:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1787384590.958171:0:15479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1787384590.958232:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970304:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384590.958272:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384590.958303:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34623d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787384590.958519:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195970304 00000100:00100000:0.0:1787384590.958525:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195970304 00000100:00100000:0.0:1787384590.958563:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787384590.958571:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195970304:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384590.958733:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374902850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195970304:12345-0@lo:502:mount.lustre.0 Request processed in 162us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384590.958740:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787384590.958894:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970304:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787384590.959335:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1787384590.959385:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1787384590.959435:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1787384590.959477:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1787384590.959513:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1787384590.959576:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1787384590.959627:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1787384590.959664:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1787384590.959694:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970432:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787384590.959737:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384590.959765:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34623d000 going to sleep for 11 seconds 00000100:00100000:0.0:1787384590.959846:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195970432 00000100:00100000:0.0:1787384590.959852:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195970432 00000100:00100000:0.0:1787384590.959902:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787384590.959910:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195970432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787384590.960322:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195970432:12345-0@lo:502:mount.lustre.0 Request processed in 411us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384590.960330:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787384590.960556:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970432:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787384590.960675:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787384590.960689:0:15479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1787384590.967357:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384590.967371:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384590.967374:0:15485:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787384590.967381:0:15485:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e37419f800 00000020:00000080:2.0:1787384590.967384:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787384590.967390:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384590.967392:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384590.967399:0:15485:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1787384590.967402:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384590.967404:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384590.967405:0:15485:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1787384590.967408:0:15485:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff89e37419f800 00000020:00000080:2.0:1787384590.967410:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787384590.967465:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384590.967469:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384590.967470:0:15485:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1787384590.967472:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787384590.967475:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384590.967476:0:15485:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787384590.967479:0:15485:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff89e37419f800 00000020:00000080:2.0:1787384590.967481:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787384590.967519:0:15485:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787384590.967522:0:15485:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787384590.967523:0:15485:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1787384590.967526:0:15485:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787384590.967575:0:15479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787384590.967609:0:15479:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384590.967630:0:15479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.967641:0:15479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384590.967677:0:15479:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787384590.967679:0:15479:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff89e37419f800 10000000:01000000:2.0:1787384590.967682:0:15479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff89e37419f800 10000000:01000000:2.0:1787384590.967686:0:15479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787384590.967692:0:15479:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff89e37419f800 from 1 10000000:01000000:2.0:1787384590.967694:0:15479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787384590.967732:0:15479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb2c00/0x3522fbed3b6c4618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.967741:0:15479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e379eb2c00/0x3522fbed3b6c4618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.967753:0:15479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e379eb2c00/0x3522fbed3b6c4618 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384590.967776:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970560:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787384590.967838:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384590.967900:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34623d0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787384590.967923:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195970560 00000100:00100000:2.0:1787384590.967928:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195970560 00000100:00100000:2.0:1787384590.972715:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787384590.972728:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195970560:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384590.972744:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384590.972763:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c461f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c4618 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.972789:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c461f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c4618 expref: 19 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.972800:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e379eb3400/0x3522fbed3b6c461f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4618 expref: 19 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.972809:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3400, rc 0) 00000100:00100000:2.0:1787384590.972889:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:15479:x1874208195970560:12345-0@lo:101:mount.lustre.0 Request processed in 163us (5050us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384590.972895:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787384590.972976:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970560:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787384590.972992:0:15479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e379eb2c00/0x3522fbed3b6c4618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c461f expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384590.973002:0:15479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e379eb2c00/0x3522fbed3b6c4618 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c461f expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384590.973544:0:15479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787384590.973833:0:15479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384590.974111:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787384590.974159:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787384590.974198:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787384590.974248:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787384590.974303:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787384590.974375:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787384590.974418:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787384590.974453:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787384590.974514:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787384590.974549:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787384590.974589:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787384590.974640:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787384590.974673:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787384590.974706:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787384590.974746:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787384590.974780:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787384590.974813:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787384590.974888:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787384590.974926:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787384590.974962:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787384590.975028:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787384590.975065:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787384590.975101:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787384590.975172:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787384590.975208:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787384590.975242:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787384590.975287:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787384590.975320:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787384590.975354:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787384590.975411:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787384590.975445:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787384590.975471:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787384590.975496:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787384590.975533:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787384590.975560:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787384590.987005:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787384590.987107:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787384590.987206:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787384590.987215:0:15479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1787384590.987316:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970688:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787384590.987378:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384590.987418:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34623d0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384590.990800:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195970688 00000100:00100000:0.0:1787384590.990814:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195970688 00000100:00100000:0.0:1787384590.992617:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787384590.992635:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:15479:x1874208195970688:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787384590.992961:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:15479:x1874208195970688:12345-0@lo:501:mount.lustre.0 Request processed in 331us (5581us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384590.992968:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787384590.995526:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970688:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787384590.995597:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970816:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787384590.995664:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384590.995706:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3507f3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787384590.995756:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195970816 00000100:00100000:3.0:1787384590.995764:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195970816 00000100:00100000:3.0:1787384590.995814:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787384590.995824:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:15479:x1874208195970816:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787384590.996021:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:15479:x1874208195970816:12345-0@lo:503:mount.lustre.0 Request processed in 198us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384590.996029:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787384590.997675:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970816:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787384590.998278:0:15479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787384590.998362:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970944:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384590.998423:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384590.998453:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3507f3180 going to sleep for 11 seconds 00000100:00100000:3.0:1787384590.998533:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195970944 00000100:00100000:3.0:1787384590.998539:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195970944 00000100:00100000:3.0:1787384590.998594:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787384590.998603:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:15479:x1874208195970944:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384590.998799:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:15479:x1874208195970944:12345-0@lo:502:mount.lustre.0 Request processed in 196us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384590.998806:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787384590.998854:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195970944:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787384590.999099:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787384590.999150:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787384590.999184:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787384590.999234:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787384590.999271:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787384590.999319:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787384590.999356:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787384590.999405:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787384590.999455:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787384590.999493:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787384590.999529:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787384590.999618:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787384590.999662:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787384590.999698:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787384590.999750:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787384590.999790:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787384590.999826:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787384590.999900:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787384590.999938:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787384590.999974:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787384591.000023:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787384591.000059:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787384591.000093:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787384591.000143:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787384591.000181:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787384591.000217:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787384591.000275:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787384591.000329:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787384591.000365:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787384591.000412:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787384591.000445:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787384591.000478:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787384591.000511:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787384591.000560:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787384591.000609:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787384591.000660:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787384591.000698:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787384591.000733:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787384591.000782:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787384591.000819:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787384591.000888:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195971072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787384591.000948:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384591.000970:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787384591.001338:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195971072 00000100:00100000:1.0:1787384591.001346:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195971072 00000100:00100000:1.0:1787384591.001390:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1787384591.001397:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:15479:x1874208195971072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787384591.001573:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:15479:x1874208195971072:12345-0@lo:502:mount.lustre.0 Request processed in 175us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384591.001589:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787384591.001683:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195971072:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787384591.001754:0:15479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787384591.001764:0:15479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1787384591.007736:0:15490:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787384591.007755:0:15490:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff89e351ef8000) 00000020:00000080:0.0:1787384591.009258:0:15490:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1787384591.012321:0:15490:0:(tgt_mount.c:153:server_get_mount()) get mount ffff89e37419f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787384591.012328:0:15490:0:(tgt_mount.c:187:server_put_mount()) put mount ffff89e37419f800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1787384591.012331:0:15490:0:(obd_mount.c:710:lustre_put_lsi()) put ffff89e37419f800 3 00010000:00080000:2.0:1787384591.012365:0:15490:0:(ldlm_lib.c:102:import_set_conn()) imp ffff89e2425ae800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.151@tcp at head 00010000:00010000:2.0:1787384591.014887:0:15490:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787384591.014976:0:15490:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787384591.015010:0:15490:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787384591.015023:0:15490:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x3522fbed3b6c462d 00000100:00080000:2.0:1787384591.015033:0:15490:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787384591.015038:0:15490:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff89e2425ae800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:2.0:1787384591.015070:0:15490:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e241331f80 x1874208195971200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787384591.015112:0:15490:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787384591.015421:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874208195971200:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1787384591.015483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787384591.015664:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787384591.015675:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787384591.015678:0:36:0:(import.c:65:import_set_state_nolock()) ffff89e349ebd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1787384591.015681:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195971328:0@lo:400:kworker.0 00000100:00080000:1.0:1787384591.015682:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 449 00000100:00080000:1.0:1787384591.015687:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1787384591.015691:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e349ebd800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:1.0:1787384591.015705:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e37315d500 x1874208195971456/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384591.015720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384591.015748:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195971456:0@lo:8:kworker.0 00000100:00100000:0.0:1787384591.015966:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384591.015997:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195971328 00000100:00100000:0.0:1787384591.016003:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195971328 00000100:00100000:0.0:1787384591.016047:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195971456 00000100:00100000:0.0:1787384591.016050:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195971456 00000100:00100000:0.0:1787384591.016061:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384591.016068:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874208195971328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384591.016137:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373148700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1874208195971328:12345-0@lo:400:kworker.0 Request processed in 69us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384591.016144:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384591.016158:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384591.016162:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37314b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874208195971456:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1787384591.016202:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37314b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3303:x1874208195971456:12345-0@lo:8:kworker.0 Request processed in 38us (236us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787384591.016208:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787384591.016226:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384591.016256:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195971328:0@lo:400:kworker.0 00000100:00100000:0.0:1787384591.016280:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787384591.016285:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e349ebd800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787384591.016293:0:3303:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787384591.016297:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195971456:0@lo:8:kworker.0 00000100:00100000:2.0:1787384591.017652:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195971200 00000100:00100000:2.0:1787384591.017663:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195971200 00000100:00100000:2.0:1787384591.017701:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384591.017708:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37314a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3303:x1874208195971200:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1787384591.017731:0:14174:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1787384591.017802:0:14174:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x3522fbed3b6c4634 00000004:00100000:2.0:1787384591.017817:0:14174:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1787384591.017851:0:14174:0:(import.c:65:import_set_state_nolock()) ffff89e2425ad800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384591.017904:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195971584:0@lo:400:kworker.0 00000100:00100000:3.0:1787384591.017954:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384591.017982:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384591.017989:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195971712:0@lo:400:kworker.0 00000100:00100000:3.0:1787384591.018012:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384591.018046:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195971584 00000100:00100000:3.0:1787384591.018050:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195971584 00000100:00100000:3.0:1787384591.018071:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195971712 00000100:00100000:3.0:1787384591.018074:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195971712 00000100:00100000:3.0:1787384591.018096:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384591.018103:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195971584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384591.018167:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37314a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1874208195971200:12345-0@lo:38:llog_process_th.0 Request processed in 458us (2681us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384591.018169:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3306:x1874208195971584:12345-0@lo:400:kworker.0 Request processed in 66us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384591.018181:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787384591.018190:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787384591.018202:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787384591.018211:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195971712:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1787384591.018218:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787384591.018247:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37315c000 x1874208195971584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384591.018249:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195971712:12345-0@lo:400:kworker.0 Request processed in 39us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384591.018265:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787384591.018270:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3306:1874208195971584:0@lo:400:kworker.0 00010000:00080000:3.0:1787384591.018301:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e37315dc00 x1874208195971712/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384607 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1787384591.018307:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff89e241331f80 x1874208195971200/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787384601 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384591.018327:0:3303:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00100000:3.0:1787384591.018334:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195971712:0@lo:400:kworker.0 00000100:00080000:2.0:1787384591.018335:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787384591.018344:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787384591.018350:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787384591.018353:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e2425ae800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787384591.018360:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3303:1874208195971200:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1787384591.018510:0:15490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787384591.018624:0:15479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787384591.018647:0:15479:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787384591.018668:0:15479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb2c00/0x3522fbed3b6c4618 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c461f expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384591.018679:0:15479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e379eb2c00/0x3522fbed3b6c4618 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c461f expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787384591.018717:0:15479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787384591.018720:0:15479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384591.018721:0:15479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384591.018723:0:15479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384591.018724:0:15479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384591.018725:0:15479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384591.018727:0:15479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384591.018730:0:15479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384591.018731:0:15479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384591.018736:0:15479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787384591.018738:0:15479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787384591.018740:0:15479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384591.018741:0:15479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384591.018742:0:15479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384591.018744:0:15479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384591.018745:0:15479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384591.018746:0:15479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384591.018748:0:15479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384591.018749:0:15479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787384591.018767:0:15479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787384591.018780:0:15479:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195971840:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787384591.018816:0:15479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384591.018852:0:15479:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787384591.018928:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195971840 00000100:00100000:2.0:1787384591.018933:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195971840 00000100:00100000:2.0:1787384591.018999:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787384591.019007:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:15479:x1874208195971840:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787384591.019028:0:14167:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787384591.019042:0:14167:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1787384591.042435:0:14167:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787384591.042454:0:14167:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787384591.042510:0:14189:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787384591.042526:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787384591.042547:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384591.042566:0:14189:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e3413fc800/0x3522fbed3b6c450e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4507 expref: 19 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384591.042574:0:14189:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384591.042674:0:14189:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e3413fc800/0x3522fbed3b6c450e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c4507 expref: 19 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384591.042688:0:14189:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e3413fc800/0x3522fbed3b6c450e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c4507 expref: 19 pid: 14167 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384591.042704:0:14189:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14189:1874208195971968:0@lo:104: 00000100:00100000:3.0:1787384591.042762:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384591.042828:0:14189:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e2429d8900 going to sleep for 11 seconds 00000100:00100000:2.0:1787384591.042890:0:14157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195971968 00000100:00100000:2.0:1787384591.042898:0:14157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195971968 00000100:00100000:2.0:1787384591.042982:0:14157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384591.042993:0:14157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+3:14189:x1874208195971968:12345-0@lo:104: 00010000:00010000:2.0:1787384591.043006:0:14157:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043071:0:14157:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787384591.043078:0:14157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+3:14189:x1874208195971968:12345-0@lo:104: Request processed in 87us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384591.043085:0:14157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787384591.043173:0:14189:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14189:1874208195971968:0@lo:104: 00010000:00010000:2.0:1787384591.043199:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384591.043206:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043214:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a400 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:2.0:1787384591.043218:0:14161:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043226:0:14161:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787384591.043240:0:14161:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384591.043246:0:14161:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787384591.043310:0:14161:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043318:0:14161:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787384591.043341:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043348:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e35108a400/0x3522fbed3b6c4507 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c450e expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043363:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384591.043365:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384591.043367:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384591.043406:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3304:1874208195972096:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787384591.043433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384591.043502:0:14160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195972096 00000100:00100000:2.0:1787384591.043505:0:14160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195972096 00010000:00010000:2.0:1787384591.043521:0:14160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e3413fc800/0x3522fbed3b6c450e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c4507 expref: 20 pid: 14167 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384591.043548:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384591.043554:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+20:3304:x1874208195972096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384591.043563:0:14160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384591.043568:0:14160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e3413fc800/0x3522fbed3b6c450e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c4507 expref: 20 pid: 14167 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043577:0:14160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e3413fc800/0x3522fbed3b6c450e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c4507 expref: 20 pid: 14167 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043610:0:14160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e3413fc800/0x3522fbed3b6c450e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c4507 expref: 20 pid: 14167 timeout: 552 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043621:0:14160:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043629:0:14160:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787384591.043640:0:14160:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.007067332s 00010000:00010000:2.0:1787384591.043644:0:14160:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043650:0:14160:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043656:0:14160:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043662:0:14160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043667:0:14160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384591.043671:0:14160:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043678:0:14160:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043686:0:14160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.043699:0:14160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384591.043725:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3304:x1874208195972096:12345-0@lo:103:ldlm_bl.0 Request processed in 171us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384591.043732:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787384591.043754:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3304:1874208195972096:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384591.044888:0:14189:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.044962:0:14189:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.044972:0:14189:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384591.044978:0:14189:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e341677c00/0x3522fbed3b6c463b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384591.054442:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:15479:x1874208195971840:12345-0@lo:253:mount.lustre.0 Request processed in 35427us (35616us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384591.054458:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787384591.054697:0:15479:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:15479:1874208195971840:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787384591.054711:0:15479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787384591.054714:0:15479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787384591.054717:0:15479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787384591.054718:0:15479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787384591.054719:0:15479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787384591.054721:0:15479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787384591.054722:0:15479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787384591.054724:0:15479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787384591.054725:0:15479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787384591.054727:0:15479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787384591.054751:0:15479:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787384591.060248:0:15479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1787384591.060386:0:15479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787384591.060515:0:15479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787384591.062949:0:15479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787384591.063138:0:15479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787384591.063314:0:15479:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787384591.064400:0:15479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787384591.227912:0:15479:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787384591.227922:0:15479:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787384591.227953:0:15479:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787384591.228009:0:15479:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.151@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787384591.228022:0:15479:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787384591.228051:0:15479:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1787384591.689316:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787384592.090951:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787384592.090974:0:6600:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 10000000:01000000:0.0:1787384592.328938:0:14170:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787384592.328946:0:14170:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff89e372969000 from 8 10000000:01000000:0.0:1787384592.328951:0:14170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787384592.329014:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108b000/0x3522fbed3b6c4642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384592.329027:0:14170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e35108b000/0x3522fbed3b6c4642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384592.329038:0:14170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e35108b000/0x3522fbed3b6c4642 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384592.329064:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195972224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787384592.329137:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384592.329209:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aefa80 going to sleep for 11 seconds 00000100:00100000:3.0:1787384592.329223:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195972224 00000100:00100000:3.0:1787384592.329247:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195972224 00000100:00100000:3.0:1787384592.329441:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787384592.329450:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:14170:x1874208195972224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384592.329475:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384592.329489:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e341676400/0x3522fbed3b6c4649 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c4642 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384592.329529:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e341676400/0x3522fbed3b6c4649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c4642 expref: 19 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384592.329541:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e341676400/0x3522fbed3b6c4649 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4642 expref: 19 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384592.329550:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e341676400, rc 0) 00000100:00100000:3.0:1787384592.329609:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ea7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:14170:x1874208195972224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384592.329616:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787384592.329910:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195972224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384592.329925:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e35108b000/0x3522fbed3b6c4642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4649 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384592.329933:0:14170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e35108b000/0x3522fbed3b6c4642 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c4649 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384592.330012:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195972352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1787384592.330044:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384592.330139:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aefa80 going to sleep for 11 seconds 00000100:00100000:2.0:1787384592.330641:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195972352 00000100:00100000:2.0:1787384592.330654:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195972352 00000100:00100000:2.0:1787384592.331036:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787384592.331046:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:14170:x1874208195972352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787384592.331066:0:14167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787384592.331083:0:14167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787384592.331086:0:14167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787384592.331193:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:14170:x1874208195972352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 149us (1147us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384592.331201:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1787384592.331284:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195972352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787384592.331351:0:14170:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787384592.331361:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e35108b000/0x3522fbed3b6c4642 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4649 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384592.331369:0:14170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e35108b000/0x3522fbed3b6c4642 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c4649 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384592.713610:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384593.737009:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384593.994620:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787384593.994642:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195972480:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384593.994703:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384593.994802:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195972480 00000100:00100000:1.0:1787384593.994810:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195972480 00000100:00080000:3.0:1787384593.995509:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384593.995599:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384593.995611:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195972480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384593.995644:0:14812:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384593.995764:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195972480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 157us (1060us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384593.995771:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384593.996086:0:3304:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787384593.996107:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195972480:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787384594.763342:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384595.229395:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787384595.787969:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384596.044333:0:3307:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787384596.044396:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384596.044425:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195972736:0@lo:400:kworker.0 00000100:00100000:1.0:1787384596.044513:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384596.054689:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3307:1874208195972608:0@lo:400:kworker.0 00000100:00100000:2.0:1787384596.054781:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384596.054911:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195972608 00000100:00100000:3.0:1787384596.054919:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195972608 00000100:00100000:3.0:1787384596.054970:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787384596.054979:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3307:x1874208195972608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384596.055034:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3307:x1874208195972608:12345-0@lo:400:kworker.0 Request processed in 55us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384596.055041:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787384596.055141:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3307:1874208195972608:0@lo:400:kworker.0 00000100:00100000:1.0:1787384596.062096:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195972736 00000100:00100000:1.0:1787384596.062120:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195972736 00000100:00100000:1.0:1787384596.062201:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384596.062212:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195972736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384596.062300:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195972736:12345-0@lo:400:kworker.0 Request processed in 90us (17787us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384596.062307:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787384596.062355:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373148000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195972736:0@lo:400:kworker.0 00000100:00080000:0.0:1787384596.064682:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1787384596.064691:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1787384596.064695:0:37:0:(import.c:65:import_set_state_nolock()) ffff89e349ebd800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1787384596.064707:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff89e349ebd800 using connection 192.168.203.151@tcp/0@lo 00000100:00100000:0.0:1787384596.064777:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff89e373149f80 x1874208195972864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787384596.064807:0:3303:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195972864:0@lo:8:kworker.0 00000100:00100000:0.0:1787384596.064985:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384596.065034:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195972864 00000100:00100000:0.0:1787384596.065040:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195972864 00000100:00100000:0.0:1787384596.065073:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384596.065080:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3303:x1874208195972864:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1787384596.065107:0:14808:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 457 last 0 00000020:00000080:0.0:1787384596.065134:0:14808:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x3522fbed3b6c4650 00002000:00100000:0.0:1787384596.065148:0:14808:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff89e2418ca800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113671 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787384596.065161:0:14808:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1787384596.065164:0:14808:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787384596.065779:0:14808:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787384596.065810:0:14808:0:(import.c:65:import_set_state_nolock()) ffff89e2418cf000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787384596.066011:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384596.066053:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373148a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1874208195972864:12345-0@lo:8:kworker.0 Request processed in 971us (1068us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384596.066061:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1787384596.066103:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e373149f80 x1874208195972864/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787384621 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1787384596.066119:0:3303:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1787384596.066127:0:3303:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787384596.066131:0:3303:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787384596.066134:0:3303:0:(import.c:65:import_set_state_nolock()) ffff89e349ebd800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787384596.066234:0:3303:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787384596.066242:0:3303:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3303:1874208195972864:0@lo:8:kworker.0 00000100:00100000:0.0:1787384596.066296:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195972992:0@lo:400:kworker.0 00000100:00100000:0.0:1787384596.066329:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384596.066365:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195972992 00000100:00100000:0.0:1787384596.066370:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195972992 00000100:00100000:0.0:1787384596.066403:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1787384596.066421:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37314b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195972992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384596.066459:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37314b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195972992:12345-0@lo:400:kworker.0 Request processed in 49us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384596.066473:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1787384596.066903:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e373149f80 x1874208195972992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384596.066930:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195972992:0@lo:400:kworker.0 00000100:00100000:0.0:1787384596.066965:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195973120:0@lo:400:kworker.0 00000100:00100000:0.0:1787384596.066993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384596.067026:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195973120 00000100:00100000:0.0:1787384596.067030:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195973120 00000100:00100000:0.0:1787384596.067060:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384596.067066:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195973120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384596.067099:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373148000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1874208195973120:12345-0@lo:400:kworker.0 Request processed in 33us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384596.067104:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1787384596.067129:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e373149f80 x1874208195973120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384596.067139:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3305:1874208195973120:0@lo:400:kworker.0 00000100:00080000:0.0:1787384596.067153:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384596.067181:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195973248:0@lo:400:kworker.0 00000100:00100000:0.0:1787384596.067204:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384596.067227:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195973248 00000100:00100000:0.0:1787384596.067230:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195973248 00000100:00100000:0.0:1787384596.067253:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787384596.067260:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195973248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384596.067291:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373149180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195973248:12345-0@lo:400:kworker.0 Request processed in 31us (86us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384596.067297:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1787384596.067309:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787384596.067330:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e373149f80 x1874208195973248/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384612 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384596.067339:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373149f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195973248:0@lo:400:kworker.0 00000004:00080000:2.0:1787384596.067917:0:14197:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787384596.068339:0:14197:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 457211478141ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787384596.078571:0:14198:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:3.0:1787384596.078603:0:14198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14198:1874208195973504:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1787384596.078669:0:14198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384596.078728:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195973504 00000100:00100000:3.0:1787384596.078736:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195973504 00000100:00100000:3.0:1787384596.078787:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384596.078796:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14198:x1874208195973504:12345-0@lo:5:osp-pre-1-0.0 00000100:00080000:0.0:1787384596.081036:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384596.081051:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787384596.081071:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195973376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384596.081138:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384596.081183:0:14813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195973376 00000100:00100000:0.0:1787384596.081189:0:14813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195973376 00000100:00100000:0.0:1787384596.081225:0:14813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787384596.081232:0:14813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874208195973376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787384596.081260:0:14813:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384596.081303:0:14813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373149f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3306:x1874208195973376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 70us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384596.081310:0:14813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1787384596.081349:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e37c4e7480 x1874208195973376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787384612 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787384596.089539:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195973376:0@lo:13:osp-pre-1-0.0 00002000:00080000:3.0:1787384596.095501:0:14811:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1787384596.095511:0:14811:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1787384596.095517:0:14811:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00100000:2.0:1787384596.096947:0:14198:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e345587e40 going to sleep for 11 seconds 00002000:00010000:3.0:1787384596.116564:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.116577:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4657 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.116593:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.116597:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.116604:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.116635:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.116646:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4657 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.116653:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.116677:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384596.116692:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384596.116698:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.116706:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384596.116711:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4657 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.116720:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4657 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.116735:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4657 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.116743:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4657 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.116768:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.116770:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.116772:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.117268:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.117275:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c465e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.117284:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.117287:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.117291:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c465e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.117300:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c465e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.117308:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c465e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.117315:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c465e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.117338:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.119651:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.119666:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c465e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.119692:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.119698:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c465e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.119709:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c465e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.119733:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c465e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.119741:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c465e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.119761:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.119763:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.120138:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.122205:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.122219:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca368f12/0x3522fbed3b6c4665 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.122248:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.122252:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.122259:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca368f12/0x3522fbed3b6c4665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.122273:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca368f12/0x3522fbed3b6c4665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.122283:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca368f12/0x3522fbed3b6c4665 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.122293:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca368f12/0x3522fbed3b6c4665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.122328:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.123640:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.123652:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca368f12/0x3522fbed3b6c4665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.123663:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676e00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.123678:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca368f12/0x3522fbed3b6c4665 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.123690:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca368f12/0x3522fbed3b6c4665 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.123710:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca368f12/0x3522fbed3b6c4665 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.123717:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca368f12/0x3522fbed3b6c4665 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.123738:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.123740:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.123742:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.124159:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.124167:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010361ec9/0x3522fbed3b6c466c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.124178:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.125040:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.125048:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010361ec9/0x3522fbed3b6c466c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.125063:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010361ec9/0x3522fbed3b6c466c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.125087:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010361ec9/0x3522fbed3b6c466c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.125096:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010361ec9/0x3522fbed3b6c466c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.125132:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.125442:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.125449:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010361ec9/0x3522fbed3b6c466c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.125459:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.125472:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010361ec9/0x3522fbed3b6c466c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.125501:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010361ec9/0x3522fbed3b6c466c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.125517:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010361ec9/0x3522fbed3b6c466c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.125525:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010361ec9/0x3522fbed3b6c466c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.125555:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.125558:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.125560:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.125719:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.125726:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e2441e0/0x3522fbed3b6c4673 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.125735:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.125739:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.125744:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e2441e0/0x3522fbed3b6c4673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.125753:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e2441e0/0x3522fbed3b6c4673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.125762:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003e2441e0/0x3522fbed3b6c4673 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.125770:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e2441e0/0x3522fbed3b6c4673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.125806:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.125880:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.125887:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e2441e0/0x3522fbed3b6c4673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.125896:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.125970:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e2441e0/0x3522fbed3b6c4673 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.125980:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e2441e0/0x3522fbed3b6c4673 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.125994:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e2441e0/0x3522fbed3b6c4673 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.126015:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e2441e0/0x3522fbed3b6c4673 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.126030:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.126032:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.126035:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.126239:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.126245:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082216dc5/0x3522fbed3b6c467a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.126254:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.126257:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.126261:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000082216dc5/0x3522fbed3b6c467a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.126270:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000082216dc5/0x3522fbed3b6c467a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.126277:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000082216dc5/0x3522fbed3b6c467a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.126284:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000082216dc5/0x3522fbed3b6c467a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.126306:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.126354:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.126360:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000082216dc5/0x3522fbed3b6c467a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.126368:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.126372:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000082216dc5/0x3522fbed3b6c467a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.126379:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000082216dc5/0x3522fbed3b6c467a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.126390:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000082216dc5/0x3522fbed3b6c467a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.126397:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082216dc5/0x3522fbed3b6c467a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.126423:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.126425:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.126429:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.128260:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.128271:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4681 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.128284:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.128294:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.128299:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.128312:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.128535:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4681 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.128543:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.128641:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384596.128653:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384596.128659:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.128666:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384596.128671:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4681 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.128680:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4681 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.128696:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4681 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.128715:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000384d6c65/0x3522fbed3b6c4681 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.128732:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.128735:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.128737:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.132771:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.132784:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4688 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.132801:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.132805:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.132811:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.132825:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.132836:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4688 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.132843:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.132883:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.132972:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.132981:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.132991:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.132996:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4688 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.133006:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4688 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.133021:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4688 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.133028:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1f3684a/0x3522fbed3b6c4688 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.133047:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.133049:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.133051:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.133826:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.133840:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072fe00e4/0x3522fbed3b6c468f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.133852:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.133856:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.133880:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000072fe00e4/0x3522fbed3b6c468f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.133892:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000072fe00e4/0x3522fbed3b6c468f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.133900:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000072fe00e4/0x3522fbed3b6c468f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.134839:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000072fe00e4/0x3522fbed3b6c468f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.134883:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384596.135752:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384596.135761:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000072fe00e4/0x3522fbed3b6c468f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.135772:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384596.135776:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000072fe00e4/0x3522fbed3b6c468f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.135788:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000072fe00e4/0x3522fbed3b6c468f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.135822:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000072fe00e4/0x3522fbed3b6c468f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.135829:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000072fe00e4/0x3522fbed3b6c468f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.135850:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384596.135852:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384596.135853:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.140213:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.140231:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4696 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140248:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.140253:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.140259:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140273:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140291:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4696 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140299:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140328:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384596.140832:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.140839:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000342c61fe/0x3522fbed3b6c469d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140848:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.140851:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.140855:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000342c61fe/0x3522fbed3b6c469d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140887:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000342c61fe/0x3522fbed3b6c469d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140895:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000342c61fe/0x3522fbed3b6c469d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140903:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000342c61fe/0x3522fbed3b6c469d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140932:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787384596.140943:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787384596.140948:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140954:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384596.140959:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4696 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140968:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4696 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140984:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4696 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.140991:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097a78e3b/0x3522fbed3b6c4696 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141008:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384596.141011:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000342c61fe/0x3522fbed3b6c469d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141018:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677e00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384596.141022:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000342c61fe/0x3522fbed3b6c469d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141041:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000342c61fe/0x3522fbed3b6c469d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141052:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000342c61fe/0x3522fbed3b6c469d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141058:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000342c61fe/0x3522fbed3b6c469d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141070:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.141071:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.141073:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.141490:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.141496:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c46a4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141504:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.141508:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.141511:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c46a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141520:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c46a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141527:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c46a4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141541:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c46a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141574:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384596.141583:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384596.141587:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c46a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141594:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341677c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384596.141597:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c46a4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141605:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c46a4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141616:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c46a4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141624:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e08ce3f0/0x3522fbed3b6c46a4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.141638:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.141639:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.141641:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.142111:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.142123:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f63744d1/0x3522fbed3b6c46ab lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142133:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.142135:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.142140:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f63744d1/0x3522fbed3b6c46ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142149:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f63744d1/0x3522fbed3b6c46ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142157:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f63744d1/0x3522fbed3b6c46ab lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142165:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f63744d1/0x3522fbed3b6c46ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142179:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384596.142187:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384596.142190:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f63744d1/0x3522fbed3b6c46ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142196:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fc400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384596.142199:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f63744d1/0x3522fbed3b6c46ab lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142206:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f63744d1/0x3522fbed3b6c46ab lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142224:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f63744d1/0x3522fbed3b6c46ab lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142230:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f63744d1/0x3522fbed3b6c46ab lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142244:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.142245:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.142247:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.142639:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.142645:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c46b2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142653:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.142656:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.142659:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c46b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142668:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c46b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142676:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c46b2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142683:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c46b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142707:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384596.142715:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384596.142719:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c46b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142725:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fde00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384596.142729:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c46b2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142737:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c46b2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142747:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c46b2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142754:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c46b2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.142766:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.142768:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.142770:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.143156:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.143162:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000667a7e8b/0x3522fbed3b6c46b9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.143171:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=457s v=(0 0) 00010000:00010000:0.0:1787384596.144597:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.145435:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.145509:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000667a7e8b/0x3522fbed3b6c46b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.145531:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000667a7e8b/0x3522fbed3b6c46b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.145542:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000667a7e8b/0x3522fbed3b6c46b9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.145560:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000667a7e8b/0x3522fbed3b6c46b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.145592:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384596.145756:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384596.145765:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000667a7e8b/0x3522fbed3b6c46b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.145775:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fc600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384596.145781:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000667a7e8b/0x3522fbed3b6c46b9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.145791:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000667a7e8b/0x3522fbed3b6c46b9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.145807:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000667a7e8b/0x3522fbed3b6c46b9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.145814:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000667a7e8b/0x3522fbed3b6c46b9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.145853:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384596.145856:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384596.145884:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.147374:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.147387:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de43d651/0x3522fbed3b6c46c0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.147401:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.147405:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.147410:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de43d651/0x3522fbed3b6c46c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.147422:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de43d651/0x3522fbed3b6c46c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.147433:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de43d651/0x3522fbed3b6c46c0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.147577:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de43d651/0x3522fbed3b6c46c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.147605:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787384596.147680:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384596.147688:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de43d651/0x3522fbed3b6c46c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.147698:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fc800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384596.147704:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de43d651/0x3522fbed3b6c46c0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.147726:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de43d651/0x3522fbed3b6c46c0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.147744:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de43d651/0x3522fbed3b6c46c0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.147752:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de43d651/0x3522fbed3b6c46c0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.147783:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384596.147785:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384596.147787:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.148345:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.148352:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000063ad24c/0x3522fbed3b6c46c7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.148362:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.148366:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.148371:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000063ad24c/0x3522fbed3b6c46c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.148381:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000063ad24c/0x3522fbed3b6c46c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.148389:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000063ad24c/0x3522fbed3b6c46c7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.148396:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000063ad24c/0x3522fbed3b6c46c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.148415:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787384596.149255:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787384596.149265:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000063ad24c/0x3522fbed3b6c46c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.149276:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fd600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384596.149281:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000063ad24c/0x3522fbed3b6c46c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.149290:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000063ad24c/0x3522fbed3b6c46c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.149305:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000063ad24c/0x3522fbed3b6c46c7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.149312:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000063ad24c/0x3522fbed3b6c46c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.149331:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384596.149333:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384596.149335:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.149818:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.149825:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afdd928f/0x3522fbed3b6c46ce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.149843:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.149846:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.149852:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afdd928f/0x3522fbed3b6c46ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.149879:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afdd928f/0x3522fbed3b6c46ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.149889:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afdd928f/0x3522fbed3b6c46ce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.149897:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afdd928f/0x3522fbed3b6c46ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.149924:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787384596.149934:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384596.149938:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afdd928f/0x3522fbed3b6c46ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.149945:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fdc00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384596.149949:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afdd928f/0x3522fbed3b6c46ce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.149958:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afdd928f/0x3522fbed3b6c46ce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.149979:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afdd928f/0x3522fbed3b6c46ce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.149986:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afdd928f/0x3522fbed3b6c46ce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.149998:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.150000:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.150001:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787384596.150472:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.150478:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c83b1b9/0x3522fbed3b6c46d5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.150487:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.150490:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.150494:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c83b1b9/0x3522fbed3b6c46d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.150503:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c83b1b9/0x3522fbed3b6c46d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.150511:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c83b1b9/0x3522fbed3b6c46d5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.150519:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c83b1b9/0x3522fbed3b6c46d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.151046:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787384596.151745:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787384596.151754:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c0ca353/0x3522fbed3b6c46dc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.151766:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=457s v=(0 0) 00010000:00010000:3.0:1787384596.151769:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384596.151773:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004c0ca353/0x3522fbed3b6c46dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.151783:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004c0ca353/0x3522fbed3b6c46dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.151790:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004c0ca353/0x3522fbed3b6c46dc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384596.151797:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004c0ca353/0x3522fbed3b6c46dc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.158770:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787384596.158784:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c83b1b9/0x3522fbed3b6c46d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.158812:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fce00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384596.158817:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c83b1b9/0x3522fbed3b6c46d5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.158827:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c83b1b9/0x3522fbed3b6c46d5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.158850:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c83b1b9/0x3522fbed3b6c46d5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.158882:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c83b1b9/0x3522fbed3b6c46d5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.160181:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384596.160189:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004c0ca353/0x3522fbed3b6c46dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.160199:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fcc00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384596.160203:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004c0ca353/0x3522fbed3b6c46dc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.160213:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004c0ca353/0x3522fbed3b6c46dc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.160230:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004c0ca353/0x3522fbed3b6c46dc lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.160247:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384596.160249:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384596.160251:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384596.160751:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384596.160818:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787384596.160828:0:14811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004c0ca353/0x3522fbed3b6c46dc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787384596.175232:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787384596.176065:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384596.176196:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009004d2fd/0x3522fbed3b6c46e3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.176216:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=457s v=(0 0) 00010000:00010000:2.0:1787384596.176221:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384596.176227:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009004d2fd/0x3522fbed3b6c46e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.176241:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009004d2fd/0x3522fbed3b6c46e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.176265:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009004d2fd/0x3522fbed3b6c46e3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.176273:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009004d2fd/0x3522fbed3b6c46e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.176295:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.176590:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.176599:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009004d2fd/0x3522fbed3b6c46e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.176609:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2600 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.176614:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009004d2fd/0x3522fbed3b6c46e3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.176635:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009004d2fd/0x3522fbed3b6c46e3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.176654:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009004d2fd/0x3522fbed3b6c46e3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.176662:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009004d2fd/0x3522fbed3b6c46e3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.176686:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.176690:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.176692:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384596.176800:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384596.176806:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c46ea lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.176815:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=457s v=(0 0) 00010000:00010000:2.0:1787384596.176817:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384596.176821:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c46ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.176829:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c46ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.176836:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c46ea lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.176842:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c46ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.176884:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.177013:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.177019:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c46ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.177028:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.177032:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c46ea lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.177040:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c46ea lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.177051:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c46ea lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.177069:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c46ea lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.177084:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.177086:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.177088:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384596.180711:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384596.180724:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67001ed/0x3522fbed3b6c46f1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.180742:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=457s v=(0 0) 00010000:00010000:2.0:1787384596.180746:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384596.180753:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67001ed/0x3522fbed3b6c46f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.180767:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a67001ed/0x3522fbed3b6c46f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.180778:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67001ed/0x3522fbed3b6c46f1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.180785:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a67001ed/0x3522fbed3b6c46f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.180810:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.181887:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.181897:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a67001ed/0x3522fbed3b6c46f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.181920:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3800 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.181925:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67001ed/0x3522fbed3b6c46f1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.181935:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67001ed/0x3522fbed3b6c46f1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.181955:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a67001ed/0x3522fbed3b6c46f1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.181963:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a67001ed/0x3522fbed3b6c46f1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.181987:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.189774:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.189789:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384596.197362:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384596.197379:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c46f8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.197398:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=457s v=(0 0) 00010000:00010000:2.0:1787384596.197412:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384596.197420:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c46f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.197434:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c46f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.197458:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c46f8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.197467:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c46f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.197498:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.197508:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.197517:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c46f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.197528:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.197534:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c46f8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.197543:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c46f8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.197575:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c46f8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.197583:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c46f8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.197610:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.197612:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.197614:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384596.201447:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384596.201461:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c46ff lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.201477:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=457s v=(0 0) 00010000:00010000:2.0:1787384596.201482:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384596.201488:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c46ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.201503:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c46ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.201513:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c46ff lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.201527:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c46ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.201558:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.201985:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.201994:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c46ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.202004:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3a00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.202009:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c46ff lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.202030:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c46ff lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.202048:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c46ff lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.202056:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d9d31cfa/0x3522fbed3b6c46ff lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.202079:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.202081:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.202083:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384596.205296:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384596.205313:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab409157/0x3522fbed3b6c4706 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.205329:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=457s v=(0 0) 00010000:00010000:2.0:1787384596.205334:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384596.205339:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab409157/0x3522fbed3b6c4706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.205351:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab409157/0x3522fbed3b6c4706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.205361:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab409157/0x3522fbed3b6c4706 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.205369:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab409157/0x3522fbed3b6c4706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.205396:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787384596.205525:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787384596.205533:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab409157/0x3522fbed3b6c4706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.205542:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2400 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384596.205556:0:14162:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab409157/0x3522fbed3b6c4706 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.205566:0:14162:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab409157/0x3522fbed3b6c4706 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.205582:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab409157/0x3522fbed3b6c4706 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.205600:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab409157/0x3522fbed3b6c4706 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384596.205624:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.205627:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787384596.205629:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787384596.210640:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787384596.210654:0:14811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c470d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.210678:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=457s v=(0 0) 00010000:00010000:2.0:1787384596.210683:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384596.210689:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c470d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.210703:0:14811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c470d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.210713:0:14811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c470d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.210722:0:14811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c470d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384596.210753:0:14811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1787384596.211536:0:14811:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1787384596.211643:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14198:x1874208195973504:12345-0@lo:5:osp-pre-1-0.0 Request processed in 132843us (132969us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384596.211653:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384596.211713:0:14198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14198:1874208195973504:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787384596.211728:0:14198:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1787384596.211771:0:14198:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14198:1874208195973632:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1787384596.211805:0:14198:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384596.211846:0:14198:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e34410f600 going to sleep for 11 seconds 00000100:00100000:2.0:1787384596.211887:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195973632 00000100:00100000:2.0:1787384596.211893:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195973632 00010000:00010000:0.0:1787384596.212371:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384596.212380:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c470d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.212400:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2000 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384596.212406:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c470d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.212415:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c470d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.212435:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c470d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.212442:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c470d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384596.212467:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384596.212470:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384596.212472:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384596.212627:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384596.212639:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14198:x1874208195973632:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1787384596.212678:0:14809:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1787384596.229136:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241333800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14198:x1874208195973632:12345-0@lo:5:osp-pre-1-0.0 Request processed in 16493us (17322us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787384596.229151:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787384596.229216:0:14198:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14198:1874208195973632:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1787384596.229232:0:14198:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000001:00100000:3.0:1787384596.692682:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787384596.692716:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1787384596.810978:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384597.834477:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384598.859030:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787384598.869226:0:15838:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg351-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1787384599.121114:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195973760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384599.121187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384599.135665:0:14813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195973760 00000100:00100000:0.0:1787384599.135681:0:14813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195973760 00000100:00100000:0.0:1787384599.136159:0:14813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787384599.136170:0:14813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195973760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384599.136205:0:14813:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384599.136429:0:14813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195973760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (15180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384599.136439:0:14813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1787384599.136476:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384599.139046:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195973760:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787384599.882035:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384600.905148:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384601.166082:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195973888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787384601.166152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384601.166905:0:14813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195973888 00000100:00100000:2.0:1787384601.166914:0:14813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195973888 00000100:00100000:2.0:1787384601.166974:0:14813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787384601.166984:0:14813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195973888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787384601.167021:0:14813:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384601.167135:0:14813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195973888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 152us (982us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.167142:0:14813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787384601.167478:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787384601.167520:0:3305:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1787384601.167545:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195973888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787384601.169536:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3306:1874208195974016:0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.169605:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384601.169642:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195974528:0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.169666:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384601.169688:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384601.169693:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195974144:0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.169730:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384601.169762:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195974272:0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.169783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384601.169799:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384601.169804:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195974400:0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.169830:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384601.169880:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195974016 00000100:00100000:2.0:1787384601.169887:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195974016 00000100:00100000:2.0:1787384601.169928:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787384601.169937:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3306:x1874208195974016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.169977:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3306:x1874208195974016:12345-0@lo:400:kworker.0 Request processed in 41us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.169984:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787384601.170013:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195974528 00000100:00100000:2.0:1787384601.170016:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195974528 00000100:00100000:2.0:1787384601.170052:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195974272 00000100:00100000:2.0:1787384601.170055:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195974272 00000100:00100000:2.0:1787384601.170068:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195974400 00000100:00100000:2.0:1787384601.170070:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195974400 00000100:00100000:2.0:1787384601.170083:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384601.170088:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195974528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.170117:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195974528:12345-0@lo:400:kworker.0 Request processed in 29us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.170123:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787384601.170134:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384601.170139:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195974272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.170166:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195974272:12345-0@lo:400:kworker.0 Request processed in 27us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.170179:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384601.170191:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384601.170197:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195974400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.170225:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195974400:12345-0@lo:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.170231:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787384601.170249:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195974144 00000100:00100000:2.0:1787384601.170252:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195974144 00000100:00100000:2.0:1787384601.170276:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787384601.170281:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195974144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.170309:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241333100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195974144:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.170314:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787384601.170356:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e241331f80 x1874208195974400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384601.170369:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195974400:0@lo:400:kworker.0 00010000:00080000:2.0:1787384601.170379:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e241333480 x1874208195974272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384601.170387:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241333480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195974272:0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.170413:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195974144:0@lo:400:kworker.0 00000100:00100000:2.0:1787384601.170420:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3306:1874208195974016:0@lo:400:kworker.0 00010000:00080000:2.0:1787384601.170429:0:3306:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff89e241331500 x1874208195974528/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787384617 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787384601.170449:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195974528:0@lo:400:kworker.0 00000100:00080000:2.0:1787384601.170979:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384601.170985:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384601.304195:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384601.305246:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173957760 00000100:00100000:2.0:1787384601.305261:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173957760 00000100:00100000:2.0:1787384601.305320:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 75 00000100:00100000:2.0:1787384601.305329:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2349:x1874208173957760:12345-192.168.203.51@tcp:250:mount.lustre.0 00010000:00080000:2.0:1787384601.305358:0:14165:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 1cf36f9e-bc75-4227-b914-014ee123b1de@192.168.203.51@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1787384601.305386:0:14165:0:(genops.c:1406:class_connect()) connect: client 1cf36f9e-bc75-4227-b914-014ee123b1de, cookie 0x3522fbed3b6c4714 00000100:00080000:2.0:1787384601.305526:0:14165:0:(import.c:65:import_set_state_nolock()) ffff89e2425aa800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384601.305598:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+5:2349:x1874208173957760:12345-192.168.203.51@tcp:250:mount.lustre.0 Request processed in 268us (1411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.305606:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 75 00000100:00100000:2.0:1787384601.322953:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384601.324523:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173957888 00000100:00100000:1.0:1787384601.324538:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173957888 00000100:00100000:1.0:1787384601.324647:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 76 00000100:00100000:1.0:1787384601.324658:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+5:13692:x1874208173957888:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787384601.324673:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384601.324692:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624c000/0x3522fbed3b6c471b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee790c4 expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384601.324719:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624c000/0x3522fbed3b6c471b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790c4 expref: 6 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384601.324731:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624c000/0x3522fbed3b6c471b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790c4 expref: 6 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384601.324740:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c000, rc 0) 00000100:00100000:1.0:1787384601.324809:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+6:13692:x1874208173957888:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 153us (1870us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384601.324830:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 76 00000100:00100000:3.0:1787384601.337429:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384601.337562:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173958016 00000100:00100000:2.0:1787384601.337581:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173958016 00000100:00100000:2.0:1787384601.337662:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00100000:2.0:1787384601.337673:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+6:13692:x1874208173958016:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787384601.338623:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+6:13692:x1874208173958016:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 943us (1195us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787384601.338637:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 77 00000100:00100000:3.0:1787384601.340954:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384601.341329:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173958144 00000100:00100000:1.0:1787384601.341339:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173958144 00000100:00100000:1.0:1787384601.341520:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 78 00000100:00100000:1.0:1787384601.341533:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+6:13692:x1874208173958144:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787384601.341550:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384601.341569:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624c200/0x3522fbed3b6c4722 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee790cb expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384601.341598:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624c200/0x3522fbed3b6c4722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790cb expref: 7 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384601.341610:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624c200/0x3522fbed3b6c4722 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790cb expref: 7 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384601.341620:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c200, rc 0) 00000100:00100000:1.0:1787384601.341679:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+7:13692:x1874208173958144:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 148us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.346089:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384601.346217:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173958272 00000100:00100000:3.0:1787384601.346238:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173958272 00000100:00100000:1.0:1787384601.346723:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 78 00000100:00100000:3.0:1787384601.347157:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:3.0:1787384601.347171:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+7:13692:x1874208173958272:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787384601.347731:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+8:13692:x1874208173958272:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 562us (1647us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384601.347739:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 79 00000100:00100000:3.0:1787384601.350908:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384601.351597:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173958400 00000100:00100000:1.0:1787384601.351609:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173958400 00000100:00100000:1.0:1787384601.351668:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:1.0:1787384601.351677:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+8:13692:x1874208173958400:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:1.0:1787384601.352104:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+8:13692:x1874208173958400:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 427us (1207us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384601.352112:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 80 00000100:00100000:1.0:1787384601.361461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384601.362109:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173958528 00000100:00100000:0.0:1787384601.362125:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173958528 00000100:00100000:0.0:1787384601.362211:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:0.0:1787384601.362221:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+8:13710:x1874208173958528:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384601.362755:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+8:13710:x1874208173958528:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 533us (1305us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384601.362764:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 81 00000100:00100000:2.0:1787384601.400118:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384601.400284:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173958656 00000100:00100000:3.0:1787384601.400294:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173958656 00000100:00100000:3.0:1787384601.400346:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:3.0:1787384601.400357:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+8:13710:x1874208173958656:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384601.400765:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+8:13710:x1874208173958656:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 409us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384601.400781:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 82 00000100:00100000:3.0:1787384601.412296:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384601.412824:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173958784 00000100:00100000:1.0:1787384601.412835:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173958784 00000100:00100000:1.0:1787384601.412924:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:1.0:1787384601.412933:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+8:13692:x1874208173958784:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787384601.412949:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384601.412965:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624c600/0x3522fbed3b6c4729 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee790f5 expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384601.413006:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624c600/0x3522fbed3b6c4729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790f5 expref: 9 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384601.413018:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624c600/0x3522fbed3b6c4729 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790f5 expref: 9 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384601.413028:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624c600, rc 0) 00000100:00100000:1.0:1787384601.413282:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+9:13692:x1874208173958784:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 348us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384601.413291:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 83 00000100:00100000:1.0:1787384601.425537:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384601.428298:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173958912 00000100:00100000:0.0:1787384601.428319:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173958912 00000100:00100000:0.0:1787384601.428409:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:0.0:1787384601.428421:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+9:13692:x1874208173958912:12345-192.168.203.51@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787384601.428453:0:14167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787384601.428484:0:14167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787384601.428489:0:14167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787384601.428492:0:14167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787384601.428494:0:14167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1787384601.430973:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+9:13692:x1874208173958912:12345-192.168.203.51@tcp:256:mount.lustre.0 Request processed in 2544us (5439us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384601.431011:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 84 00000100:00100000:3.0:1787384601.439366:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384601.440387:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173959040 00000100:00100000:0.0:1787384601.440586:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173959040 00000100:00100000:0.0:1787384601.440654:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 85 00000100:00100000:0.0:1787384601.440664:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+9:13692:x1874208173959040:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787384601.440681:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384601.440699:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c4730 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee790fc expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384601.440725:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c4730 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790fc expref: 10 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384601.440736:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c4730 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790fc expref: 10 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384601.440745:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108bc00, rc 0) 00000100:00100000:0.0:1787384601.442296:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+10:13692:x1874208173959040:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 1624us (2932us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384601.442308:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 85 00000100:00100000:1.0:1787384601.452707:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384601.452848:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173959168 00000100:00100000:0.0:1787384601.452879:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173959168 00000100:00100000:0.0:1787384601.452943:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 86 00000100:00100000:0.0:1787384601.452954:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+10:13692:x1874208173959168:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:0.0:1787384601.453265:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+10:13692:x1874208173959168:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 312us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384601.453273:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 86 00000100:00100000:2.0:1787384601.457914:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384601.457996:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173959296 00000100:00100000:0.0:1787384601.458005:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173959296 00000100:00100000:0.0:1787384601.458063:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:0.0:1787384601.458072:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+10:13692:x1874208173959296:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787384601.458803:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372946c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+10:13692:x1874208173959296:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 729us (896us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384601.458812:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 87 00000100:00100000:3.0:1787384601.469827:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384601.470727:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173959424 00000100:00100000:1.0:1787384601.470738:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173959424 00000100:00100000:1.0:1787384601.470797:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 88 00000100:00100000:1.0:1787384601.470808:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+10:13714:x1874208173959424:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787384601.472853:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372944450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+10:13714:x1874208173959424:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 342us (1331us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384601.472899:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 88 00000100:00100000:1.0:1787384601.479986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384601.480312:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173959552 00000100:00100000:0.0:1787384601.480322:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173959552 00000100:00100000:0.0:1787384601.480374:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:0.0:1787384601.480383:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+10:13714:x1874208173959552:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384601.480836:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372946450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+10:13714:x1874208173959552:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 452us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384601.480845:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 89 00000100:00100000:3.0:1787384601.503140:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384601.507152:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173959680 00000100:00100000:2.0:1787384601.507175:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173959680 00000100:00100000:2.0:1787384601.507251:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:2.0:1787384601.507263:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2349:x1874208173959680:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787384601.507331:0:14173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 5d51bcff-d531-4b76-b235-b18c0e21ed53@192.168.203.51@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1787384601.507402:0:14173:0:(genops.c:1406:class_connect()) connect: client 5d51bcff-d531-4b76-b235-b18c0e21ed53, cookie 0x3522fbed3b6c4737 00000004:00100000:2.0:1787384601.507443:0:14173:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787384601.507451:0:14173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1787384601.553485:0:14173:0:(import.c:65:import_set_state_nolock()) ffff89e372775000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384601.553788:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:2349:x1874208173959680:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 46525us (50661us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384601.553800:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:0.0:1787384601.567317:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384601.567480:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384601.572298:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173959936 00000100:00100000:2.0:1787384601.572314:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173959936 00000100:00100000:2.0:1787384601.572456:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173959808 00000100:00100000:2.0:1787384601.572460:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173959808 00000100:00100000:1.0:1787384601.572716:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:1.0:1787384601.572729:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:13692:x1874208173959936:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787384601.572775:0:14174:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787384601.572876:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373148e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:13692:x1874208173959936:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 135us (5554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384601.572884:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:1.0:1787384601.572904:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1787384601.572910:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:0:x1874208173959808:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:1.0:1787384601.572921:0:14174:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1787384601.572944:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373149c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:0:x1874208173959808:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 34us (5465us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384601.572949:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00080000:0.0:1787384601.573836:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384601.577348:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384601.577734:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173960064 00000100:00100000:0.0:1787384601.577745:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173960064 00000100:00100000:0.0:1787384601.577800:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1787384601.577809:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:13692:x1874208173960064:12345-192.168.203.51@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787384601.577916:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:13692:x1874208173960064:12345-192.168.203.51@tcp:40:mount.lustre.0 Request processed in 107us (577us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384601.577924:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1787384601.581937:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384601.581976:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384601.582924:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173960192 00000100:00100000:2.0:1787384601.582935:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173960192 00000100:00100000:2.0:1787384601.582977:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:1.0:1787384601.583208:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384601.583257:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874208173960192:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787384601.583290:0:14809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 5d51bcff-d531-4b76-b235-b18c0e21ed53@192.168.203.51@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1787384601.583321:0:14809:0:(genops.c:1406:class_connect()) connect: client 5d51bcff-d531-4b76-b235-b18c0e21ed53, cookie 0x3522fbed3b6c473e 00002000:00100000:2.0:1787384601.583333:0:14809:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5d51bcff-d531-4b76-b235-b18c0e21ed53/ffff89e2425ac800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787384601.583357:0:14809:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787384601.583766:0:14809:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787384601.583797:0:14809:0:(import.c:65:import_set_state_nolock()) ffff89e2425ad000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384601.583888:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:2349:x1874208173960192:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 902us (1960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.583897:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:2.0:1787384601.583915:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173960320 00000100:00100000:2.0:1787384601.583919:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173960320 00000100:00100000:2.0:1787384601.583932:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1787384601.583937:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874208173960320:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787384601.583953:0:14809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 5d51bcff-d531-4b76-b235-b18c0e21ed53@192.168.203.51@tcp t0 exp 0000000000000000 cur 462 last 0 00000020:00000080:2.0:1787384601.583983:0:14809:0:(genops.c:1406:class_connect()) connect: client 5d51bcff-d531-4b76-b235-b18c0e21ed53, cookie 0x3522fbed3b6c4745 00002000:00100000:2.0:1787384601.583989:0:14809:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5d51bcff-d531-4b76-b235-b18c0e21ed53/ffff89e2425ae000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787384601.583995:0:14809:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787384601.584199:0:14809:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787384601.584216:0:14809:0:(import.c:65:import_set_state_nolock()) ffff89e37296b800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384601.584241:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:2349:x1874208173960320:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 302us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.584248:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1787384601.585355:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173960448 00000100:00100000:2.0:1787384601.585365:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173960448 00000100:00100000:2.0:1787384601.585672:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1787384601.585683:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:13692:x1874208173960448:12345-192.168.203.51@tcp:33:mount.lustre.0 00000004:00080000:2.0:1787384601.589093:0:14176:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3348us 00000004:00200000:2.0:1787384601.605744:0:14176:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1787384601.605949:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:13692:x1874208173960448:12345-192.168.203.51@tcp:33:mount.lustre.0 Request processed in 20263us (23967us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.605960:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000001:00100000:0.0:1787384601.761610:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5d51bcff-d531-4b76-b235-b18c0e21ed53 00000100:00100000:1.0:1787384601.796808:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384601.796934:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173960576 00000100:00100000:2.0:1787384601.796944:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173960576 00000100:00100000:2.0:1787384601.797012:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:2.0:1787384601.797022:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:13735:x1874208173960576:12345-192.168.203.51@tcp:101:mkdir.0 00010000:00010000:2.0:1787384601.797042:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384601.797066:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c474c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79126 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384601.797145:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4753 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384601.797158:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4753 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384601.797171:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4753 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384601.797361:0:14175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787384601.797365:0:14175:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384601.797454:0:14175:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4753 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384601.797481:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c474c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79126 expref: 8 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384601.797496:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4753 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79126 expref: 7 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384601.797504:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e345695f00) 00010000:00010000:2.0:1787384601.797644:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384601.797649:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3800, rc 0) 00000100:00100000:2.0:1787384601.797708:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:13735:x1874208173960576:12345-192.168.203.51@tcp:101:mkdir.0 Request processed in 687us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384601.797715:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00010000:00010000:1.0:1787384601.929270:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787384602.250190:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5d51bcff-d531-4b76-b235-b18c0e21ed53 00010000:00010000:0.0:1787384602.953081:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384603.840577:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384603.840717:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173960704 00000100:00100000:0.0:1787384603.840731:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173960704 00000100:00080000:2.0:1787384603.840882:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787384603.840981:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:0.0:1787384603.840995:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:13787:x1874208173960704:12345-192.168.203.51@tcp:41:lfs.0 00000004:00000024:0.0:1787384603.841061:0:14174:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787384603.841176:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:13787:x1874208173960704:12345-192.168.203.51@tcp:41:lfs.0 Request processed in 183us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384603.841184:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:1.0:1787384603.846966:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384603.847088:0:14813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173960832 00000100:00100000:2.0:1787384603.847118:0:14813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173960832 00000100:00100000:2.0:1787384603.847217:0:14813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:2.0:1787384603.847229:0:14813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:13787:x1874208173960832:12345-192.168.203.51@tcp:13:lfs.0 00002000:00000024:2.0:1787384603.847289:0:14813:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384603.847393:0:14813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:13787:x1874208173960832:12345-192.168.203.51@tcp:13:lfs.0 Request processed in 165us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384603.847401:0:14813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00080000:0.0:1787384603.848006:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384603.851511:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384603.851708:0:14813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173960960 00000100:00100000:2.0:1787384603.851721:0:14813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173960960 00000100:00100000:2.0:1787384603.851816:0:14813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:2.0:1787384603.851829:0:14813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:13787:x1874208173960960:12345-192.168.203.51@tcp:13:lfs.0 00002000:00000024:2.0:1787384603.851917:0:14813:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787384603.852174:0:14813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:13787:x1874208173960960:12345-192.168.203.51@tcp:13:lfs.0 Request processed in 347us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384603.852183:0:14813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00080000:0.0:1787384603.852337:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787384603.977173:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384604.064378:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384604.064533:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173961088 00000100:00100000:3.0:1787384604.064546:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173961088 00000100:00100000:3.0:1787384604.064628:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00100000:3.0:1787384604.064641:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+10:13819:x1874208173961088:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384604.064664:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384604.064687:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e37b8fcc00/0x3522fbed3b6c475a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7912d expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384604.064723:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e37b8fcc00/0x3522fbed3b6c475a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7912d expref: 11 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384604.064736:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e37b8fcc00/0x3522fbed3b6c475a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7912d expref: 11 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384604.064747:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fcc00, rc 0) 00000100:00100000:3.0:1787384604.064822:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372947c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13819:x1874208173961088:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 183us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384604.064830:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 90 00000100:00100000:1.0:1787384604.079008:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384604.079563:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173961216 00000100:00100000:2.0:1787384604.079578:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173961216 00000100:00100000:2.0:1787384604.079657:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 91 00000100:00100000:2.0:1787384604.079667:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13819:x1874208173961216:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787384604.080102:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372944c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13819:x1874208173961216:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 433us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384604.080112:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 91 00000100:00100000:1.0:1787384604.105627:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384604.105774:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173961344 00000100:00100000:0.0:1787384604.105786:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173961344 00000100:00100000:0.0:1787384604.105849:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 92 00000100:00100000:0.0:1787384604.105889:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13819:x1874208173961344:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787384604.106224:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372946050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13819:x1874208173961344:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 364us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384604.106233:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 92 00000100:00100000:1.0:1787384604.119121:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384604.119594:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173961472 00000100:00100000:3.0:1787384604.119606:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173961472 00000100:00100000:3.0:1787384604.119729:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 93 00000100:00100000:3.0:1787384604.119742:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13827:x1874208173961472:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787384604.120139:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372945050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13827:x1874208173961472:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 398us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384604.120149:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 93 00000100:00100000:1.0:1787384604.145779:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384604.145890:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173961600 00000100:00100000:0.0:1787384604.145904:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173961600 00000100:00100000:0.0:1787384604.145975:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 94 00000100:00100000:0.0:1787384604.145987:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13827:x1874208173961600:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384604.146377:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372947450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13827:x1874208173961600:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 390us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384604.146386:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 94 00000100:00100000:1.0:1787384604.153058:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384604.153618:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173961728 00000100:00100000:3.0:1787384604.153633:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173961728 00000100:00100000:3.0:1787384604.153703:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 95 00000100:00100000:3.0:1787384604.153714:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13819:x1874208173961728:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787384604.153737:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384604.153761:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e37b8fdc00/0x3522fbed3b6c4761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79157 expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384604.153795:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e37b8fdc00/0x3522fbed3b6c4761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79157 expref: 12 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384604.153809:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e37b8fdc00/0x3522fbed3b6c4761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79157 expref: 12 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384604.153821:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fdc00, rc 0) 00000100:00100000:3.0:1787384604.153921:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372945450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+12:13819:x1874208173961728:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 208us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384604.153929:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 95 00000100:00100000:1.0:1787384604.160564:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384604.164827:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173961856 00000100:00100000:2.0:1787384604.164846:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173961856 00000100:00100000:2.0:1787384604.164949:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 96 00000100:00100000:2.0:1787384604.164961:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+12:13819:x1874208173961856:12345-192.168.203.51@tcp:256:mount.lustre.0 20000000:01000000:2.0:1787384604.165014:0:14167:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1787384604.165092:0:14167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1787384604.165097:0:14167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1787384604.165101:0:14167:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1787384604.165104:0:14167:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787384604.172066:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372944850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+12:13819:x1874208173961856:12345-192.168.203.51@tcp:256:mount.lustre.0 Request processed in 7091us (11499us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384604.172086:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 96 00000100:00100000:1.0:1787384604.180575:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384604.181392:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173961984 00000100:00100000:0.0:1787384604.181428:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173961984 00000100:00100000:0.0:1787384604.181511:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:0.0:1787384604.181523:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+12:13819:x1874208173961984:12345-192.168.203.51@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787384604.181544:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384604.181567:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c4768 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7915e expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384604.181603:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c4768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7915e expref: 13 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384604.181616:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c4768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7915e expref: 13 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384604.181627:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108aa00, rc 0) 00000100:00100000:0.0:1787384604.182466:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372945c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13819:x1874208173961984:12345-192.168.203.51@tcp:101:mount.lustre.0 Request processed in 938us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384604.182478:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 97 00000100:00100000:1.0:1787384604.193559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384604.193653:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173962112 00000100:00100000:2.0:1787384604.193666:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173962112 00000100:00100000:2.0:1787384604.193733:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:2.0:1787384604.193744:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13819:x1874208173962112:12345-192.168.203.51@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787384604.194541:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372945850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13819:x1874208173962112:12345-192.168.203.51@tcp:501:mount.lustre.0 Request processed in 790us (990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384604.194551:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 98 00000100:00100000:1.0:1787384604.197738:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384604.197894:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173962240 00000100:00100000:0.0:1787384604.197907:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173962240 00000100:00100000:0.0:1787384604.198012:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00100000:0.0:1787384604.198033:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13819:x1874208173962240:12345-192.168.203.51@tcp:503:mount.lustre.0 00000100:00100000:0.0:1787384604.198521:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372944050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13819:x1874208173962240:12345-192.168.203.51@tcp:503:mount.lustre.0 Request processed in 498us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384604.198531:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 99 00000100:00100000:2.0:1787384604.201511:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384604.201968:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173962368 00000100:00100000:0.0:1787384604.201983:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173962368 00000100:00100000:0.0:1787384604.202061:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 100 00000100:00100000:0.0:1787384604.202073:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13832:x1874208173962368:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384604.202664:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372946850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13832:x1874208173962368:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 589us (1170us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384604.202675:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 100 00000100:00100000:1.0:1787384604.208803:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384604.208946:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173962496 00000100:00100000:0.0:1787384604.208960:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173962496 00000100:00100000:0.0:1787384604.209032:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 101 00000100:00100000:0.0:1787384604.209044:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e372947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13832:x1874208173962496:12345-192.168.203.51@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787384604.209403:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e372947050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13832:x1874208173962496:12345-192.168.203.51@tcp:502:llog_process_th.0 Request processed in 359us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384604.209412:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 101 00000100:00100000:1.0:1787384604.214524:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384604.214687:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173962624 00000100:00100000:3.0:1787384604.214699:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173962624 00000100:00100000:3.0:1787384604.214818:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:3.0:1787384604.214827:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2349:x1874208173962624:12345-192.168.203.51@tcp:38:mount.lustre.0 00010000:00080000:3.0:1787384604.214908:0:14173:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from ef19089e-b2ce-45c8-b7f7-153fd5841ca9@192.168.203.51@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:3.0:1787384604.214961:0:14173:0:(genops.c:1406:class_connect()) connect: client ef19089e-b2ce-45c8-b7f7-153fd5841ca9, cookie 0x3522fbed3b6c476f 00000004:00100000:3.0:1787384604.215001:0:14173:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787384604.215160:0:14173:0:(import.c:65:import_set_state_nolock()) ffff89e372773000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787384604.215261:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2349:x1874208173962624:12345-192.168.203.51@tcp:38:mount.lustre.0 Request processed in 434us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384604.215269:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:2.0:1787384604.219937:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384604.220032:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384604.220066:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384604.220101:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384604.220154:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173963264 00000100:00100000:0.0:1787384604.220166:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173963264 00000100:00100000:0.0:1787384604.220236:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173963136 00000100:00100000:0.0:1787384604.220240:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173963136 00000100:00100000:0.0:1787384604.220262:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:0.0:1787384604.220273:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2352:x1874208173963264:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384604.220385:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2352:x1874208173963264:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 113us (363us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384604.220393:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:0.0:1787384604.220414:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:0.0:1787384604.220421:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2352:x1874208173963136:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384604.220457:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2352:x1874208173963136:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 37us (390us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384604.220463:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:2.0:1787384604.224448:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384604.224813:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173963008 00000100:00100000:3.0:1787384604.224826:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173963008 00000100:00100000:3.0:1787384604.228169:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173962752 00000100:00100000:3.0:1787384604.228190:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173962752 00000100:00080000:2.0:1787384604.228563:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384604.228632:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173962880 00000100:00100000:3.0:1787384604.228637:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173962880 00000100:00100000:3.0:1787384604.228666:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:3.0:1787384604.228680:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+7:0:x1874208173962752:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787384604.228737:0:14175:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787384604.228935:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:2.0:1787384604.228945:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+7:13819:x1874208173962880:12345-192.168.203.51@tcp:41:mount.lustre.0 00000004:00000024:2.0:1787384604.228961:0:14173:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787384604.229032:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241333480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+7:0:x1874208173962752:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 348us (8919us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384604.229040:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:3.0:1787384604.229114:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1787384604.229120:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:2352:x1874208173963008:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384604.229890:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:13819:x1874208173962880:12345-192.168.203.51@tcp:41:mount.lustre.0 Request processed in 939us (5458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384604.229920:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:3.0:1787384604.231232:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:2352:x1874208173963008:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 2099us (11297us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384604.231249:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1787384604.233272:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195974656:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384604.233375:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384604.233576:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195974656 00000100:00100000:1.0:1787384604.233587:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195974656 00000100:00100000:1.0:1787384604.233663:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787384604.233674:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195974656:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787384604.233701:0:14812:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384604.233755:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3307:x1874208195974656:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384604.233764:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787384604.233819:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3307:1874208195974656:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787384604.235013:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384604.239169:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384604.239294:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173963392 00000100:00100000:1.0:1787384604.239307:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173963392 00000100:00100000:1.0:1787384604.239399:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:1.0:1787384604.239412:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:13819:x1874208173963392:12345-192.168.203.51@tcp:40:mount.lustre.0 00000100:00100000:1.0:1787384604.239551:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:13819:x1874208173963392:12345-192.168.203.51@tcp:40:mount.lustre.0 Request processed in 142us (398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384604.239557:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:0.0:1787384604.248950:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384604.248999:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384604.249060:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384604.249163:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173963520 00000100:00100000:2.0:1787384604.249176:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173963520 00000100:00100000:2.0:1787384604.249230:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173963648 00000100:00100000:2.0:1787384604.249234:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173963648 00000100:00100000:2.0:1787384604.249251:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:2.0:1787384604.249261:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874208173963520:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787384604.249304:0:14809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from ef19089e-b2ce-45c8-b7f7-153fd5841ca9@192.168.203.51@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:2.0:1787384604.249346:0:14809:0:(genops.c:1406:class_connect()) connect: client ef19089e-b2ce-45c8-b7f7-153fd5841ca9, cookie 0x3522fbed3b6c4776 00002000:00100000:2.0:1787384604.249362:0:14809:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli ef19089e-b2ce-45c8-b7f7-153fd5841ca9/ffff89e3741fe000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787384604.249376:0:14809:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1787384604.249700:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173963776 00000100:00100000:3.0:1787384604.249705:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173963776 00002000:00080000:2.0:1787384604.249725:0:14809:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1787384604.249755:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:3.0:1787384604.249761:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:13819:x1874208173963776:12345-192.168.203.51@tcp:33:mount.lustre.0 00000100:00080000:2.0:1787384604.249763:0:14809:0:(import.c:65:import_set_state_nolock()) ffff89e3741f8800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384604.249845:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2349:x1874208173963520:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 585us (911us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384604.249854:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:2.0:1787384604.249898:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:2.0:1787384604.249903:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1874208173963648:12345-192.168.203.51@tcp:8:mount.lustre.0 00010000:00080000:2.0:1787384604.249922:0:14809:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from ef19089e-b2ce-45c8-b7f7-153fd5841ca9@192.168.203.51@tcp t0 exp 0000000000000000 cur 465 last 0 00000020:00000080:2.0:1787384604.249943:0:14809:0:(genops.c:1406:class_connect()) connect: client ef19089e-b2ce-45c8-b7f7-153fd5841ca9, cookie 0x3522fbed3b6c477d 00002000:00100000:2.0:1787384604.249949:0:14809:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli ef19089e-b2ce-45c8-b7f7-153fd5841ca9/ffff89e3741fc800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113671 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787384604.249966:0:14809:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000004:00200000:3.0:1787384604.250008:0:14177:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00002000:00080000:2.0:1787384604.250113:0:14809:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787384604.250130:0:14809:0:(import.c:65:import_set_state_nolock()) ffff89e3741fd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787384604.250155:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2349:x1874208173963648:12345-192.168.203.51@tcp:8:mount.lustre.0 Request processed in 250us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384604.250162:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:2.0:1787384604.251323:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:13819:x1874208173963776:12345-192.168.203.51@tcp:33:mount.lustre.0 Request processed in 1550us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384604.251335:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:0.0:1787384604.423025:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384604.423311:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173963904 00000100:00100000:2.0:1787384604.423324:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173963904 00000100:00100000:2.0:1787384604.423442:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:2.0:1787384604.423455:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:13853:x1874208173963904:12345-192.168.203.51@tcp:101:mkdir.0 00010000:00010000:2.0:1787384604.423481:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384604.423526:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c4784 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79188 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384604.423614:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384604.423630:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384604.423644:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384604.423940:0:14175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787384604.423946:0:14175:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384604.424212:0:14175:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384604.424247:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2400/0x3522fbed3b6c4784 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79188 expref: 8 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384604.424267:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79188 expref: 7 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384604.424276:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e345695f00) 00010000:00010000:2.0:1787384604.424279:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384604.424283:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2000, rc 0) 00000100:00100000:2.0:1787384604.424368:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+7:13853:x1874208173963904:12345-192.168.203.51@tcp:101:mkdir.0 Request processed in 916us (1357us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384604.424377:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00010000:00010000:0.0:1787384605.001100:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787384605.449604:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787384606.025059:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384606.281166:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195974912:0@lo:400:kworker.0 00000100:00100000:2.0:1787384606.281180:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195975168:0@lo:400:kworker.0 00000100:00100000:3.0:1787384606.281243:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3304:1874208195974784:0@lo:400:kworker.0 00000100:00100000:1.0:1787384606.281344:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195975040:0@lo:400:kworker.0 00000100:00100000:0.0:1787384606.281661:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384606.281717:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195975424:0@lo:400:kworker.0 00000100:00100000:0.0:1787384606.281743:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384606.281785:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195974912 00000100:00100000:0.0:1787384606.281793:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195974912 00000100:00100000:0.0:1787384606.281850:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384606.281885:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195974912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384606.282162:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195974912:12345-0@lo:400:kworker.0 Request processed in 301us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384606.282170:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1787384606.282192:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384606.282220:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241331c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195974912:0@lo:400:kworker.0 00000100:00100000:2.0:1787384606.282343:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384606.282380:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195975424 00000100:00100000:2.0:1787384606.282384:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195975424 00000100:00100000:2.0:1787384606.282416:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195975168 00000100:00100000:2.0:1787384606.282419:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195975168 00000100:00100000:2.0:1787384606.282437:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787384606.282443:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195975424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384606.282489:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787384606.282490:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1874208195975424:12345-0@lo:400:kworker.0 Request processed in 46us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384606.282495:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787384606.282497:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195975168:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1787384606.282514:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384606.282536:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3305:1874208195975424:0@lo:400:kworker.0 00000100:00100000:0.0:1787384606.282781:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3307:x1874208195975168:12345-0@lo:400:kworker.0 Request processed in 284us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384606.282788:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787384606.282854:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3307:1874208195975168:0@lo:400:kworker.0 00000100:00100000:1.0:1787384606.284278:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384606.284356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384606.284415:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195975296:0@lo:400:kworker.0 00000100:00100000:3.0:1787384606.284451:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384606.284501:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195975296 00000100:00100000:3.0:1787384606.284507:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195975296 00000100:00100000:2.0:1787384606.284735:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195974784 00000100:00100000:2.0:1787384606.284740:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195974784 00000100:00100000:2.0:1787384606.284774:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787384606.284782:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3304:x1874208195974784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384606.284832:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345173050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3304:x1874208195974784:12345-0@lo:400:kworker.0 Request processed in 49us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384606.284840:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:2.0:1787384606.284892:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787384606.284932:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241332a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3304:1874208195974784:0@lo:400:kworker.0 00000100:00100000:3.0:1787384606.285037:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384606.285045:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195975296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384606.285083:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195975296:12345-0@lo:400:kworker.0 Request processed in 38us (630us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384606.285090:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787384606.285117:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195975296:0@lo:400:kworker.0 00000100:00100000:1.0:1787384606.285288:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195975552:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384606.285326:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384606.285564:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195975552 00000100:00100000:3.0:1787384606.285569:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195975552 00000100:00100000:3.0:1787384606.285611:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384606.285618:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195975552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787384606.285645:0:14812:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384606.285686:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195975552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384606.285693:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787384606.285724:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195975552:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787384606.285876:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384606.286205:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195975040 00000100:00100000:0.0:1787384606.286211:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195975040 00000100:00100000:0.0:1787384606.286297:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787384606.286305:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195975040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384606.286361:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195975040:12345-0@lo:400:kworker.0 Request processed in 57us (2087us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384606.286368:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384606.286780:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195975040:0@lo:400:kworker.0 00000001:00100000:0.0:1787384606.878277:0:7483:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of ef19089e-b2ce-45c8-b7f7-153fd5841ca9 00000001:00100000:1.0:1787384606.894270:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of ef19089e-b2ce-45c8-b7f7-153fd5841ca9 00000001:00100000:1.0:1787384606.894290:0:5806:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5d51bcff-d531-4b76-b235-b18c0e21ed53 00010000:00010000:1.0:1787384607.052946:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787384607.422479:0:6600:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of ef19089e-b2ce-45c8-b7f7-153fd5841ca9 00000001:02000400:3.0:1787384607.425736:0:16042:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1787384608.073732:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787384609.099354:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787384609.364957:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384609.364997:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195975680:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787384609.365092:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384609.365350:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195975680 00000100:00100000:0.0:1787384609.365362:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195975680 00000100:00100000:0.0:1787384609.365451:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384609.365470:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195975680:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384609.365516:0:14812:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384609.365578:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195975680:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384609.365585:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787384609.365644:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195975680:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787384609.365761:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384609.441502:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384609.441546:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384609.441579:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384609.441601:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384609.441622:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384609.441641:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384609.441668:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384609.441696:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173964288 00000100:00100000:0.0:1787384609.441708:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173964288 00000100:00100000:0.0:1787384609.441774:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173964800 00000100:00100000:0.0:1787384609.441777:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173964800 00000100:00100000:0.0:1787384609.441794:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173964416 00000100:00100000:0.0:1787384609.441806:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173964416 00000100:00100000:0.0:1787384609.441822:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173964672 00000100:00100000:0.0:1787384609.441825:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173964672 00000100:00100000:0.0:1787384609.441843:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1787384609.441853:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2350:x1874208173964288:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384609.441978:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2350:x1874208173964288:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 125us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384609.442000:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1787384609.442024:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1787384609.442031:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2350:x1874208173964800:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384609.442059:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2350:x1874208173964800:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 29us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384609.442066:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1787384609.442078:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:0.0:1787384609.442084:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2350:x1874208173964416:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384609.442108:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2350:x1874208173964416:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 24us (465us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384609.442113:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:0.0:1787384609.442126:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:0.0:1787384609.442132:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2350:x1874208173964672:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384609.442158:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2350:x1874208173964672:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384609.442164:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:0.0:1787384609.442185:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173964544 00000100:00100000:0.0:1787384609.442196:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173964544 00000100:00100000:0.0:1787384609.442226:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173964160 00000100:00100000:0.0:1787384609.442228:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173964160 00000100:00100000:0.0:1787384609.442248:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:0.0:1787384609.442254:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2350:x1874208173964544:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384609.442285:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2350:x1874208173964544:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 31us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384609.442292:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:0.0:1787384609.442304:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:0.0:1787384609.442311:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:2350:x1874208173964160:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384609.442336:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:2350:x1874208173964160:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 26us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384609.442342:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00080000:0.0:1787384609.442374:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384609.442381:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384609.442383:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787384609.443167:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173964032 00000100:00100000:3.0:1787384609.443177:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173964032 00000100:00100000:3.0:1787384609.443238:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 103 00000100:00100000:3.0:1787384609.443247:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+13:2350:x1874208173964032:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384609.443302:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345172450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+13:2350:x1874208173964032:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 55us (1814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384609.443309:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 103 00010000:00010000:2.0:1787384610.124002:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384611.146404:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1787384611.231440:0:16192:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=c008667f len=0 uarg=00007fffbdaea090 00000020:00000080:1.0:1787384611.231470:0:16192:0:(class_obd.c:141:class_resolve_dev_name()) device name MGS 00000020:00000080:1.0:1787384611.231476:0:16192:0:(class_obd.c:148:class_resolve_dev_name()) device name MGS, dev 1 00000020:00000080:1.0:1787384611.231487:0:16192:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffbdaec320 20000000:00000080:1.0:1787384611.231494:0:16192:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff89e242c8e000 uarg=0000000000000000 20000000:01000000:1.0:1787384611.231542:0:16192:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787384611.231549:0:16192:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1787384611.231555:0:16192:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787384611.233335:0:16193:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1787384611.233604:0:16192:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787384611.245295:0:16192:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1787384611.245340:0:16192:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245363:0:16192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c4489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4482 expref: 18 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245395:0:16192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e340031400/0x3522fbed3b6c44d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c44cf expref: 18 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245402:0:16192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c4611 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c460a expref: 18 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245412:0:16192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c4730 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790fc expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245419:0:16192:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c4768 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7915e expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245439:0:16192:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245503:0:16192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c4768 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7915e expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245525:0:16192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c4768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7915e expref: 12 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384611.245544:0:16192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16192:1874208195975808:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384611.245685:0:16192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c4730 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790fc expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245694:0:16192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c4730 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790fc expref: 12 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384611.245702:0:16192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16192:1874208195975936:192.168.203.51@tcp:104: 00010000:00010000:1.0:1787384611.245747:0:16192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c4611 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c460a expref: 18 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245755:0:16192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c4611 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c460a expref: 18 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384611.245765:0:16192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37315d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16192:1874208195976064:0@lo:104: 00000100:00100000:1.0:1787384611.245814:0:16192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384611.245854:0:16192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e340031400/0x3522fbed3b6c44d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c44cf expref: 18 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245901:0:16192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e340031400/0x3522fbed3b6c44d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c44cf expref: 18 pid: 14168 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384611.245910:0:16192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373360000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16192:1874208195976192:0@lo:104: 00000100:00100000:1.0:1787384611.245933:0:16192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787384611.245956:0:16192:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c4489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x3522fbed3b6c4482 expref: 18 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384611.245964:0:16192:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c4489 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x3522fbed3b6c4482 expref: 18 pid: 14167 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384611.245972:0:16192:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373361c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16192:1874208195976320:0@lo:104: 00000100:00100000:1.0:1787384611.245995:0:16192:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384611.246005:0:16192:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346beb300 going to sleep for 11 seconds 00000100:00100000:3.0:1787384611.247196:0:14156:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787384611.247224:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195976064 00000100:00100000:3.0:1787384611.247244:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195976064 00000100:00100000:3.0:1787384611.247307:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195976192 00000100:00100000:3.0:1787384611.247311:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195976192 00000100:00100000:3.0:1787384611.247323:0:14156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195976320 00000100:00100000:3.0:1787384611.247326:0:14156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195976320 00000100:00100000:3.0:1787384611.247341:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384611.247349:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+5:16192:x1874208195976064:12345-0@lo:104: 00010000:00010000:3.0:1787384611.247366:0:14156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384611.247464:0:14156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787384611.247470:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+5:16192:x1874208195976064:12345-0@lo:104: Request processed in 122us (1656us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384611.247477:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787384611.247497:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384611.247518:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+4:16192:x1874208195976192:12345-0@lo:104: 00010000:00010000:3.0:1787384611.247526:0:14156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384611.247560:0:14156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787384611.247566:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+4:16192:x1874208195976192:12345-0@lo:104: Request processed in 49us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384611.247572:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787384611.247584:0:14156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787384611.247590:0:14156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+3:16192:x1874208195976320:12345-0@lo:104: 00010000:00010000:3.0:1787384611.247598:0:14156:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384611.247626:0:14156:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787384611.247631:0:14156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379ee6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+3:16192:x1874208195976320:12345-0@lo:104: Request processed in 42us (1636us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384611.247637:0:14156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787384611.247775:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787384611.247784:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.247793:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e341676600 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384611.247797:0:14162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.247808:0:14162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384611.247828:0:14162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384611.247835:0:14162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384611.247903:0:14162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.247911:0:14162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384611.247933:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.247940:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e341676600/0x3522fbed3b6c460a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c4611 expref: -99 pid: 15479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.247955:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787384611.247958:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.247963:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a000 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384611.247965:0:14162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.247972:0:14162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384611.247978:0:14162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384611.247982:0:14162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384611.248005:0:14162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248011:0:14162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384611.248018:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248024:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e35108a000/0x3522fbed3b6c44cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c44d6 expref: -99 pid: 14807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248033:0:14162:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787384611.248036:0:14162:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248042:0:14162:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e340030000 already unused, calling callback (ffffffffc1d4dc20) 10000000:00010000:0.0:1787384611.248044:0:14162:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248051:0:14162:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787384611.248058:0:14162:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787384611.248063:0:14162:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787384611.248076:0:14162:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248082:0:14162:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787384611.248097:0:14162:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248114:0:14162:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.151@tcp lock: ffff89e340030000/0x3522fbed3b6c4482 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x3522fbed3b6c4489 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248130:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384611.248132:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384611.248134:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384611.248152:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3304:1874208195976448:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384611.248193:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384611.248238:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384611.248244:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3304:1874208195976576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384611.248267:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384611.248294:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3306:1874208195976704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384611.248319:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384611.248358:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195976448 00000100:00100000:0.0:1787384611.248363:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195976448 00010000:00010000:0.0:1787384611.248387:0:14158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c4611 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c460a expref: 19 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384611.248403:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195976576 00000100:00100000:0.0:1787384611.248406:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195976576 00010000:00010000:0.0:1787384611.248417:0:14158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e340031400/0x3522fbed3b6c44d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c44cf expref: 20 pid: 14168 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384611.248427:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195976704 00000100:00100000:0.0:1787384611.248429:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195976704 00010000:00010000:0.0:1787384611.248451:0:14158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c4489 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c4482 expref: 21 pid: 14167 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384611.248477:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384611.248485:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+21:3304:x1874208195976448:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384611.248497:0:14158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384611.248504:0:14158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c4611 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c460a expref: 21 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248513:0:14158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c4611 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c460a expref: 21 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248534:0:14158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384611.248563:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+21:3304:x1874208195976448:12345-0@lo:103:ldlm_bl.0 Request processed in 80us (370us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384611.248570:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787384611.248592:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787384611.248598:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+20:3304:x1874208195976576:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787384611.248605:0:14158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384611.248609:0:14158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e340031400/0x3522fbed3b6c44d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c44cf expref: 20 pid: 14168 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248616:0:14158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e340031400/0x3522fbed3b6c44d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c44cf expref: 20 pid: 14168 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.248626:0:14158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384611.248641:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384611.248646:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+20:3304:x1874208195976576:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384611.248651:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787384611.248661:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787384611.248670:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3306:x1874208195976704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787384611.248679:0:14160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384611.248684:0:14160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c4489 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x3522fbed3b6c4482 expref: 19 pid: 14167 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384611.248692:0:14160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c4489 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x3522fbed3b6c4482 expref: 19 pid: 14167 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384611.248703:0:14160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384611.248733:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351fc4c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3306:x1874208195976704:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384611.249587:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3304:1874208195976576:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787384611.249615:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3304:1874208195976448:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787384611.249680:0:16192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108b200/0x3522fbed3b6c4611 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c460a expref: 19 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384611.249696:0:16192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16192:1874208195976064:0@lo:104: 00010000:00010000:1.0:1787384611.249708:0:16192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e340031400/0x3522fbed3b6c44d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c44cf expref: 18 pid: 14168 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384611.249727:0:16192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373360000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16192:1874208195976192:0@lo:104: 00010000:00010000:1.0:1787384611.249741:0:16192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c4489 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x3522fbed3b6c4482 expref: 17 pid: 14167 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384611.249749:0:16192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373361c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16192:1874208195976320:0@lo:104: 00000100:00100000:0.0:1787384611.250376:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384611.250409:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384611.250474:0:14158:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1787384611.250483:0:14158:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787384611.250701:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173964928 00000100:00100000:0.0:1787384611.250710:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173964928 00010000:00010000:0.0:1787384611.250744:0:14158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c4768 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7915e expref: 13 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384611.250766:0:14158:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787384611.250773:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173965056 00000100:00100000:0.0:1787384611.250776:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173965056 00010000:00010000:0.0:1787384611.250786:0:14158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c4730 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790fc expref: 14 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384611.250798:0:14158:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787384611.250807:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1787384611.250815:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf36f9e-bc75-4227-b914-014ee123b1de+14:2353:x1874208173964928:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384611.250829:0:14158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384611.250835:0:14158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c4768 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7915e expref: 14 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.250848:0:14158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c4768 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7915e expref: 14 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.250895:0:14158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384611.250952:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf36f9e-bc75-4227-b914-014ee123b1de+14:2353:x1874208173964928:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 137us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384611.250961:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:0.0:1787384611.250997:0:14158:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1787384611.251003:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1787384611.251009:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:2353:x1874208173965056:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787384611.251017:0:14158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384611.251021:0:14158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c4730 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790fc expref: 13 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251030:0:14158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c4730 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790fc expref: 13 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251043:0:14158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251052:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251069:0:14158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251076:0:14158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251083:0:14158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251089:0:14158:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251095:0:14158:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624da00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384611.251100:0:14158:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251118:0:14158:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251128:0:14158:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.251139:0:14158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787384611.251159:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:2353:x1874208173965056:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 150us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384611.251166:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00010000:00010000:1.0:1787384611.252083:0:16192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108aa00/0x3522fbed3b6c4768 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7915e expref: 12 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384611.252100:0:16192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16192:1874208195975808:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384611.252309:0:16192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c4730 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee790fc expref: 11 pid: 14165 timeout: 572 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384611.252320:0:16192:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37315ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16192:1874208195975936:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384611.252360:0:16192:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.252371:0:16192:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.252377:0:16192:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384611.252383:0:16192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff89e36624da00/0x3522fbed3b6c4792 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384611.256994:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3306:1874208195976704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787384611.261665:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787384611.403394:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787384611.403424:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195976832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384611.403529:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384611.403604:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195976832 00000100:00100000:1.0:1787384611.403618:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195976832 00000100:00100000:1.0:1787384611.403688:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787384611.403698:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195976832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384611.403745:0:14812:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787384611.403800:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195976832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384611.403808:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1787384611.403832:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384611.403909:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195976832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787384611.410478:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195977216:0@lo:400:kworker.0 00000100:00100000:1.0:1787384611.410584:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384611.410662:0:3307:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195977344:0@lo:400:kworker.0 00000100:00100000:1.0:1787384611.410707:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384611.410787:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195976960:0@lo:400:kworker.0 00000100:00100000:0.0:1787384611.410825:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384611.410889:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384611.410895:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195977088:0@lo:400:kworker.0 00000100:00100000:0.0:1787384611.410920:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384611.410952:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195977216 00000100:00100000:0.0:1787384611.410961:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195977216 00000100:00100000:0.0:1787384611.411035:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195977344 00000100:00100000:0.0:1787384611.411039:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195977344 00000100:00100000:0.0:1787384611.411058:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195977088 00000100:00100000:0.0:1787384611.411060:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195977088 00000100:00100000:0.0:1787384611.411075:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384611.411085:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195977216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384611.411164:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373361500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3306:x1874208195977216:12345-0@lo:400:kworker.0 Request processed in 80us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384611.411173:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787384611.411195:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384611.411203:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195977344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787384611.411238:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373361180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3306:1874208195977216:0@lo:400:kworker.0 00000100:00100000:0.0:1787384611.411243:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373363800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3307:x1874208195977344:12345-0@lo:400:kworker.0 Request processed in 39us (533us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384611.411252:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787384611.411267:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787384611.411276:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195977088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384611.411319:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195977088:12345-0@lo:400:kworker.0 Request processed in 44us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384611.411321:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195976960 00000100:00100000:1.0:1787384611.411328:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195976960 00000100:00100000:0.0:1787384611.411331:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787384611.411374:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787384611.411385:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195976960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384611.411402:0:3307:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373360e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3307:1874208195977344:0@lo:400:kworker.0 00000100:00080000:0.0:1787384611.411422:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787384611.411428:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195976960:12345-0@lo:400:kworker.0 Request processed in 45us (601us total) trans 0 rc 0/0 00000100:00080000:0.0:1787384611.411428:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384611.411438:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787384611.411534:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373362d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195977088:0@lo:400:kworker.0 00000100:00100000:3.0:1787384611.411546:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373361880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195976960:0@lo:400:kworker.0 00010000:00010000:2.0:1787384612.176344:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787384612.622263:0:14170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787384612.622275:0:14170:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e37419f800 from 10 10000000:01000000:2.0:1787384612.622282:0:14170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384612.622355:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb3a00/0x3522fbed3b6c4799 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.622370:0:14170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e379eb3a00/0x3522fbed3b6c4799 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.622384:0:14170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e379eb3a00/0x3522fbed3b6c4799 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384612.622420:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195977472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384612.622532:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384612.622603:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351fae840 going to sleep for 11 seconds 00000100:00100000:0.0:1787384612.623449:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195977472 00000100:00100000:0.0:1787384612.623461:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195977472 00000100:00100000:0.0:1787384612.623536:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787384612.623548:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+16:14170:x1874208195977472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384612.623568:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384612.623592:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c47a0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c4799 expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384612.623625:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c47a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c4799 expref: 17 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384612.623638:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e35108bc00/0x3522fbed3b6c47a0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c4799 expref: 17 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384612.623649:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108bc00, rc 0) 00000100:00100000:0.0:1787384612.623719:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345172c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:14170:x1874208195977472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384612.623726:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1787384612.623796:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195977472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787384612.623814:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e379eb3a00/0x3522fbed3b6c4799 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c47a0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384612.623823:0:14170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e379eb3a00/0x3522fbed3b6c4799 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c47a0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384612.623914:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195977600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384612.623946:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384612.623965:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384612.624010:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195977600 00000100:00100000:0.0:1787384612.624014:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195977600 00000100:00100000:0.0:1787384612.624039:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787384612.624046:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:14170:x1874208195977600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384612.624360:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345170450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:14170:x1874208195977600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 312us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384612.624368:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787384612.624406:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195977600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384612.624458:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195977728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384612.624505:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384612.624519:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5540 going to sleep for 11 seconds 00000100:00100000:0.0:1787384612.624531:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195977728 00000100:00100000:0.0:1787384612.624535:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195977728 00000100:00100000:0.0:1787384612.624555:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787384612.624562:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:14170:x1874208195977728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787384612.624727:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345171050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:14170:x1874208195977728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 164us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384612.624734:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1787384612.624772:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195977728:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787384612.632836:0:16246:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787384612.636895:0:14170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787384612.636943:0:14170:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787384612.636961:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb3a00/0x3522fbed3b6c4799 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c47a0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.636976:0:14170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e379eb3a00/0x3522fbed3b6c4799 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c47a0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787384612.637000:0:14170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1787384612.637003:0:14170:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e379ff1000 from 10 10000000:01000000:2.0:1787384612.637007:0:14170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787384612.637065:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb2400/0x3522fbed3b6c47a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.637074:0:14170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e379eb2400/0x3522fbed3b6c47a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.637106:0:14170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e379eb2400/0x3522fbed3b6c47a7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384612.637143:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195977856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787384612.637231:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384612.637294:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e351fae900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384612.638151:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195977856 00000100:00100000:1.0:1787384612.638166:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195977856 00000100:00100000:1.0:1787384612.638229:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1787384612.638240:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+17:14170:x1874208195977856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384612.638267:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384612.638287:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c47ae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c47a7 expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384612.638319:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c47ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c47a7 expref: 18 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384612.638331:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624d600/0x3522fbed3b6c47ae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c47a7 expref: 18 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384612.638342:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d600, rc 0) 00000100:00100000:1.0:1787384612.638417:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345170c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:14170:x1874208195977856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384612.638425:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1787384612.638527:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195977856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787384612.638550:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e379eb2400/0x3522fbed3b6c47a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c47ae expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384612.638573:0:14170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e379eb2400/0x3522fbed3b6c47a7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c47ae expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384612.638652:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195977984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384612.638688:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384612.638726:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aefc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787384612.638770:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195977984 00000100:00100000:2.0:1787384612.638775:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195977984 00000100:00100000:2.0:1787384612.638803:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787384612.638810:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:14170:x1874208195977984:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384612.639134:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345171850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:14170:x1874208195977984:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 323us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384612.639145:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1787384612.640282:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195977984:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384612.640360:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373362680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195978112:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384612.640429:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384612.640474:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346beb540 going to sleep for 11 seconds 00000100:00100000:1.0:1787384612.640494:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195978112 00000100:00100000:1.0:1787384612.640500:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195978112 00000100:00100000:1.0:1787384612.640547:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787384612.640568:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:14170:x1874208195978112:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787384612.640778:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345173450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:14170:x1874208195978112:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 221us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384612.640786:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1787384612.640836:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373362680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195978112:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787384612.652444:0:16247:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787384612.652716:0:14170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787384612.652750:0:14170:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787384612.652766:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e379eb2400/0x3522fbed3b6c47a7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c47ae expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384612.652781:0:14170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e379eb2400/0x3522fbed3b6c47a7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c47ae expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787384612.652792:0:14170:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787384612.652795:0:14170:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff89e372969000 from 10 10000000:01000000:1.0:1787384612.652798:0:14170:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787384612.652848:0:14170:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e36624c400/0x3522fbed3b6c47b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384612.652882:0:14170:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.151@tcp lock: ffff89e36624c400/0x3522fbed3b6c47b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384612.652909:0:14170:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.151@tcp lock: ffff89e36624c400/0x3522fbed3b6c47b5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384612.652943:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373362680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195978240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787384612.653032:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384612.653083:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346beb540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384612.654111:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195978240 00000100:00100000:2.0:1787384612.654128:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195978240 00000100:00100000:2.0:1787384612.654199:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787384612.654211:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+18:14170:x1874208195978240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384612.654232:0:14168:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384612.654261:0:14168:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c47bc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x3522fbed3b6c47b5 expref: -99 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.654294:0:14168:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c47bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x3522fbed3b6c47b5 expref: 19 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.654307:0:14168:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e379eb2e00/0x3522fbed3b6c47bc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x3522fbed3b6c47b5 expref: 19 pid: 14168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.654336:0:14168:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2e00, rc 0) 00000100:00100000:2.0:1787384612.654415:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345171c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:14170:x1874208195978240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 205us (1382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384612.654422:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1787384612.654640:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373362680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195978240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384612.654661:0:14170:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.151@tcp lock: ffff89e36624c400/0x3522fbed3b6c47b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c47bc expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384612.654673:0:14170:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.151@tcp lock: ffff89e36624c400/0x3522fbed3b6c47b5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x3522fbed3b6c47bc expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384612.654749:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e373362680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195978368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787384612.654792:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384612.654825:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346beb540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384612.655563:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195978368 00000100:00100000:2.0:1787384612.655573:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195978368 00000100:00100000:2.0:1787384612.655633:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1787384612.655644:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:14170:x1874208195978368:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384612.658067:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e373362680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195978368:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787384612.658152:0:14170:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195978496:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384612.658220:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345171450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:14170:x1874208195978368:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 385us (1234us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384612.658236:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1787384612.658252:0:14170:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384612.658289:0:14170:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5540 going to sleep for 11 seconds 00000100:00100000:2.0:1787384612.658301:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195978496 00000100:00100000:2.0:1787384612.658308:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195978496 00000100:00100000:2.0:1787384612.658359:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787384612.658367:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:14170:x1874208195978496:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384612.658694:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345170050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:14170:x1874208195978496:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 326us (442us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384612.658701:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1787384612.658890:0:14170:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f0000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:14170:1874208195978496:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1787384612.666096:0:16250:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1787384612.666544:0:14170:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1787384612.666576:0:14170:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.203.151@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787384612.666591:0:14170:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.151@tcp lock: ffff89e36624c400/0x3522fbed3b6c47b5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c47bc expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384612.666607:0:14170:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.151@tcp lock: ffff89e36624c400/0x3522fbed3b6c47b5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x3522fbed3b6c47bc expref: -99 pid: 14170 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384612.958695:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384612.958908:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173965184 00000100:00100000:1.0:1787384612.958921:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173965184 00000100:00100000:1.0:1787384612.958994:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 113 00000100:00100000:1.0:1787384612.959005:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+11:13706:x1874208173965184:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787384612.959026:0:14165:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384612.959048:0:14165:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c47c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7918f expref: -99 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384612.959082:0:14165:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c47c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7918f expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384612.959115:0:14165:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e36624d200/0x3522fbed3b6c47c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7918f expref: 12 pid: 14165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384612.959125:0:14165:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624d200, rc 0) 00000100:00100000:1.0:1787384612.959455:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345172050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+12:13706:x1874208173965184:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 450us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384612.959463:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 113 00000100:00100000:0.0:1787384612.962297:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384612.962676:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173965312 00000100:00100000:2.0:1787384612.962691:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173965312 00000100:00100000:2.0:1787384612.962766:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:2.0:1787384612.962776:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e345173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+12:13706:x1874208173965312:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787384612.963479:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e345173850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+12:13706:x1874208173965312:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 698us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384612.963492:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 114 00000100:00100000:0.0:1787384612.966684:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384612.966829:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173965440 00000100:00100000:2.0:1787384612.966840:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173965440 00000100:00100000:2.0:1787384612.967023:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:2.0:1787384612.967051:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+12:13706:x1874208173965440:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384612.967349:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374902c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+12:13706:x1874208173965440:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 299us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384612.967357:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 115 00000100:00100000:0.0:1787384612.976042:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384612.976751:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173965568 00000100:00100000:2.0:1787384612.976767:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173965568 00000100:00100000:2.0:1787384612.976846:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:2.0:1787384612.976878:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+12:13706:x1874208173965568:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787384612.976903:0:14167:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384612.976931:0:14167:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff89e379eb3200/0x3522fbed3b6c47ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79196 expref: -99 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.976968:0:14167:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff89e379eb3200/0x3522fbed3b6c47ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79196 expref: 13 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.977596:0:14167:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff89e379eb3200/0x3522fbed3b6c47ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79196 expref: 13 pid: 14167 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384612.977616:0:14167:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3200, rc 0) 00000100:00100000:2.0:1787384612.977703:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374901050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13706:x1874208173965568:12345-192.168.203.51@tcp:101:ll_cfg_requeue.0 Request processed in 846us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384612.977712:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 116 00000100:00100000:0.0:1787384612.985480:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384612.995638:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173965696 00000100:00100000:2.0:1787384612.995659:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173965696 00000100:00100000:2.0:1787384612.995743:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 117 00000100:00100000:2.0:1787384612.995756:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13706:x1874208173965696:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787384612.996186:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374901c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13706:x1874208173965696:12345-192.168.203.51@tcp:501:ll_cfg_requeue.0 Request processed in 431us (10719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384612.996194:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 117 00000100:00100000:0.0:1787384613.001536:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384613.002271:0:14167:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173965824 00000100:00100000:2.0:1787384613.002287:0:14167:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173965824 00000100:00100000:2.0:1787384613.002367:0:14167:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 118 00000100:00100000:2.0:1787384613.002378:0:14167:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13706:x1874208173965824:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787384613.002692:0:14167:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374901450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:1cf36f9e-bc75-4227-b914-014ee123b1de+13:13706:x1874208173965824:12345-192.168.203.51@tcp:503:ll_cfg_requeue.0 Request processed in 315us (1171us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384613.002702:0:14167:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 118 00010000:00010000:0.0:1787384613.194227:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787384614.220733:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384614.473166:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787384614.473201:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3779f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195978624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384614.473298:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384614.473450:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195978624 00000100:00100000:0.0:1787384614.473461:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195978624 00000100:00100000:0.0:1787384614.473540:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787384614.473550:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195978624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384614.473593:0:14812:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384614.473644:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195978624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384614.473651:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:2.0:1787384614.473807:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787384614.473897:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3779f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195978624:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384614.558098:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384614.558149:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384614.558192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384614.558217:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384614.558240:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384614.558328:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173966464 00000100:00100000:0.0:1787384614.558328:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173965952 00000100:00100000:3.0:1787384614.558340:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173966464 00000100:00100000:0.0:1787384614.558340:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173965952 00000100:00100000:3.0:1787384614.558398:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173966080 00000100:00100000:3.0:1787384614.558401:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173966080 00000100:00100000:0.0:1787384614.558401:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:0.0:1787384614.558411:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:2351:x1874208173965952:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384614.558433:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:3.0:1787384614.558440:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2351:x1874208173966464:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384614.558536:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173966208 00000100:00100000:1.0:1787384614.558541:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173966208 00000100:00100000:1.0:1787384614.558579:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173966720 00000100:00100000:1.0:1787384614.558583:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173966720 00000100:00080000:2.0:1787384614.558584:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787384614.558589:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787384614.558593:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787384614.558600:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:1.0:1787384614.558607:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2351:x1874208173966208:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384614.558627:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:2.0:1787384614.558640:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:2351:x1874208173966080:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:3.0:1787384614.558703:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2351:x1874208173966464:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 262us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384614.558710:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:3.0:1787384614.558750:0:14808:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787384614.558759:0:14808:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787384614.558921:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:3.0:1787384614.558928:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2351:x1874208173966720:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384614.563206:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374900050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:2351:x1874208173965952:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 4778us (5105us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384614.563225:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 119 00000100:00100000:1.0:1787384614.563633:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2351:x1874208173966208:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 5023us (5479us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384614.563645:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:0.0:1787384614.563806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384614.563845:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384614.563965:0:14809:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787384614.563976:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173966336 00000100:00100000:1.0:1787384614.563986:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173966336 00000100:00100000:1.0:1787384614.564036:0:14809:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787384614.564041:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173966592 00000100:00100000:1.0:1787384614.564045:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173966592 00000100:00100000:1.0:1787384614.564059:0:14809:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787384614.564067:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:1.0:1787384614.564075:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2351:x1874208173966336:12345-192.168.203.51@tcp:400:kworker.0 00000100:00080000:0.0:1787384614.564163:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787384614.564168:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787384614.565754:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2351:x1874208173966336:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 1667us (1937us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384614.565786:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:1.0:1787384614.565821:0:14809:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1787384614.565833:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:1.0:1787384614.565846:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2351:x1874208173966592:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:1.0:1787384614.565922:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2351:x1874208173966592:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 81us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384614.565929:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:3.0:1787384614.568510:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2351:x1874208173966720:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 9559us (10269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384614.568556:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:2.0:1787384614.568753:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:2351:x1874208173966080:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 10105us (10498us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384614.568766:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:0.0:1787384614.880217:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384614.880364:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173966848 00000100:00100000:3.0:1787384614.880377:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173966848 00000100:00100000:3.0:1787384614.880460:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:3.0:1787384614.880472:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:14364:x1874208173966848:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384614.880563:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384614.880594:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c47d1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7919d expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.880678:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c47d8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.880694:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c47d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.880710:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c47d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.880726:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c47df lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.880734:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c47df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.880741:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c47df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882022:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd400/0x3522fbed3b6c47e6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882058:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd400/0x3522fbed3b6c47e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882071:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd400/0x3522fbed3b6c47e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384614.882203:0:14175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1787384614.882207:0:14175:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384614.882312:0:14175:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd400/0x3522fbed3b6c47e6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882327:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c47d8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882334:0:14175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c47d8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882341:0:14175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c47d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882349:0:14175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fde00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384614.882353:0:14175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c47d8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882362:0:14175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c47d8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882376:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e345695f00) 00010000:00010000:3.0:1787384614.882380:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384614.882385:0:14175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c47d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882402:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c47d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882428:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c47df lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882434:0:14175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c47df lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882439:0:14175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c47df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882444:0:14175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fd200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384614.882447:0:14175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c47df lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882454:0:14175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c47df lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882462:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff89e34a25fd00) 00010000:00010000:3.0:1787384614.882464:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384614.882467:0:14175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c47df lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882474:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c47df lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882531:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c47d1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7919d expref: 8 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882562:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd400/0x3522fbed3b6c47e6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7919d expref: 7 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.882570:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e34a25ff00) 00010000:00010000:3.0:1787384614.882573:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384614.882576:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fd400, rc 0) 00000100:00100000:3.0:1787384614.882670:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:14364:x1874208173966848:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 2199us (2466us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384614.882680:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:0.0:1787384614.885778:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384614.885886:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173967104 00000100:00100000:3.0:1787384614.885899:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173967104 00000100:00100000:3.0:1787384614.886035:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1787384614.886048:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:14364:x1874208173967104:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384614.886076:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384614.886100:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c47ed lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791a4 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.886204:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c47f4 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.886220:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c47f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.886233:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c47f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.887506:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c47fb lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.887539:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c47fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.887551:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c47fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.889744:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd000/0x3522fbed3b6c4802 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.889764:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd000/0x3522fbed3b6c4802 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.891262:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd000/0x3522fbed3b6c4802 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384614.891279:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1787384614.891708:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c47f4 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.891718:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c47f4 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.891726:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c47f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.891732:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fca00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384614.891736:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c47f4 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.891744:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c47f4 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.892900:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff89e34a25ff00) 00010000:00010000:3.0:1787384614.892909:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384614.892916:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c47f4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.892926:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c47f4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.892941:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c47fb lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.892947:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c47fb lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.892952:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c47fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.892957:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fc000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384614.892960:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c47fb lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.892966:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c47fb lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.892978:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff89e34a25fe00) 00010000:00010000:3.0:1787384614.892980:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384614.892983:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c47fb lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.892988:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c47fb lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.894330:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c47ed lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791a4 expref: 10 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.896277:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd000/0x3522fbed3b6c4802 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791a4 expref: 9 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384614.896287:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e34a25fa00) 00010000:00010000:3.0:1787384614.896290:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384614.896294:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fd000, rc 0) 00000100:00100000:3.0:1787384614.896906:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:14364:x1874208173967104:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 10857us (11138us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787384614.896916:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:0.0:1787384614.905651:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384614.905834:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173967232 00000100:00100000:3.0:1787384614.905851:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173967232 00000100:00100000:3.0:1787384614.905959:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:3.0:1787384614.905973:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:14364:x1874208173967232:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1787384614.906126:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:14364:x1874208173967232:12345-192.168.203.51@tcp:59:lhsmtool_posix.0 Request processed in 156us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384614.906144:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1787384614.972602:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384614.972741:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173967360 00000100:00100000:2.0:1787384614.972755:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173967360 00000100:00100000:2.0:1787384614.972836:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1787384614.972847:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:14370:x1874208173967360:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384614.972921:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384614.972952:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791ab expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973037:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4817 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973055:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973069:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973085:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c481e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973093:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c481e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973101:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c481e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973658:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4817 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973678:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4817 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973686:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973693:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384614.973699:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4817 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973708:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4817 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973724:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e345695f00) 00010000:00010000:2.0:1787384614.973728:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384614.973734:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4817 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973742:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4817 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973758:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c481e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973764:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c481e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973770:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c481e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973776:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384614.973785:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c481e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973792:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c481e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973801:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e345695800) 00010000:00010000:2.0:1787384614.973804:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384614.973807:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c481e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973813:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c481e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973912:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4810 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ab expref: 10 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973924:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e345695f00) 00010000:00010000:2.0:1787384614.973926:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384614.973930:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ab expref: 10 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384614.973940:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2600, rc 0) 00000100:00100000:2.0:1787384614.974926:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373362300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:14370:x1874208173967360:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 2075us (2333us total) trans 0 rc 301/301 00000100:00100000:2.0:1787384614.974939:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:0.0:1787384614.992444:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384614.992672:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173967488 00000100:00100000:3.0:1787384614.992685:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173967488 00000100:00100000:3.0:1787384614.992750:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:3.0:1787384614.992762:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:14370:x1874208173967488:12345-192.168.203.51@tcp:700:lfs.0 00000100:00100000:3.0:1787384614.992905:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:14370:x1874208173967488:12345-192.168.203.51@tcp:700:lfs.0 Request processed in 144us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384614.992934:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:1.0:1787384615.000264:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384615.000373:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173967744 00000100:00100000:0.0:1787384615.000386:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173967744 00000100:00100000:0.0:1787384615.000464:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:0.0:1787384615.000475:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:14370:x1874208173967744:12345-192.168.203.51@tcp:36:lfs.0 00010000:00010000:0.0:1787384615.000551:0:14175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384615.000586:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4753 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79126 expref: 9 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.000611:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e345695f00) 00010000:00010000:0.0:1787384615.000616:0:14175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384615.001177:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.001195:0:14175:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79188 expref: 5 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.001205:0:14175:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.001257:0:14175:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79188 expref: 5 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.001275:0:14175:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79188 expref: 5 pid: 14175 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384615.001293:0:14175:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14175:1874208195978752:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384615.001403:0:14175:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e377db5900 going to sleep for 11 seconds 00000100:00100000:1.0:1787384615.003784:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.004010:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173967872 00000100:00100000:3.0:1787384615.004022:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173967872 00010000:00010000:3.0:1787384615.004072:0:14158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79188 expref: 6 pid: 14175 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384615.004121:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:3.0:1787384615.004132:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373363480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2353:x1874208173967872:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384615.004148:0:14158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384615.004156:0:14158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79188 expref: 6 pid: 14175 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.004171:0:14158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79188 expref: 6 pid: 14175 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.004198:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e345695f00) 00010000:00010000:3.0:1787384615.004203:0:14158:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.004215:0:14158:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.004222:0:14158:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.004243:0:14158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384615.004314:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373363480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2353:x1874208173967872:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 184us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384615.004342:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00010000:00010000:0.0:1787384615.005710:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c478b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79188 expref: 5 pid: 14175 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384615.005739:0:14175:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14175:1874208195978752:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384615.005768:0:14175:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.005778:0:14175:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.005785:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.005820:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.005833:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.005842:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384615.012463:0:14175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787384615.012491:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.012503:0:14175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.012512:0:14175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.012519:0:14175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ae00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384615.012525:0:14175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.012534:0:14175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.012557:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e345695f00) 00010000:00010000:0.0:1787384615.012560:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384615.012566:0:14175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.012573:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c4825 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384615.012605:0:14175:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ee5900a6 reply state 000000000d0eb7f5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384615.012617:0:14175:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384615.013907:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373363b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+10:14370:x1874208173967744:12345-192.168.203.51@tcp:36:lfs.0 Request processed in 13421us (13643us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1787384615.013943:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00010000:00010000:3.0:1787384615.017258:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.017281:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.017290:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.017296:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384615.017302:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.017311:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.017332:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e343ce4a00) 00010000:00010000:3.0:1787384615.017336:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384615.017341:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.017347:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b200/0x3522fbed3b6c482c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384615.101839:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.102099:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173968000 00000100:00100000:3.0:1787384615.102112:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173968000 00000100:00100000:3.0:1787384615.102189:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:3.0:1787384615.102202:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:14378:x1874208173968000:12345-192.168.203.51@tcp:101:lctl.0 00010000:00010000:3.0:1787384615.102234:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384615.102281:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c4833 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791b2 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.102364:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c483a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.102381:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c483a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.102395:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c483a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384615.102484:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787384615.102488:0:14174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384615.102539:0:14174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c483a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.102569:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c4833 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791b2 expref: 11 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.102591:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc000/0x3522fbed3b6c483a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791b2 expref: 10 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.102601:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34a25fe00) 00010000:00010000:3.0:1787384615.102605:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384615.102609:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fc000, rc 0) 00000100:00100000:3.0:1787384615.102698:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+10:14378:x1874208173968000:12345-192.168.203.51@tcp:101:lctl.0 Request processed in 498us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384615.102706:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:1.0:1787384615.154549:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.154698:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173968128 00000100:00100000:3.0:1787384615.154729:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173968128 00000100:00100000:3.0:1787384615.154979:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:3.0:1787384615.154991:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:14379:x1874208173968128:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384615.155022:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384615.155053:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c4841 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791b9 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.155157:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c4848 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.155175:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c4848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.156390:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c4848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384615.156495:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787384615.156499:0:14173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384615.156567:0:14173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c4848 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.156607:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c4841 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791b9 expref: 7 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.156632:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fca00/0x3522fbed3b6c4848 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791b9 expref: 6 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.156642:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34a25fe00) 00010000:00010000:3.0:1787384615.156646:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787384615.156651:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fca00, rc 0) 00000100:00100000:3.0:1787384615.156764:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373363100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:14379:x1874208173968128:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1774us (2228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384615.156775:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 21 00000100:00100000:1.0:1787384615.168789:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.174917:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173968256 00000100:00100000:3.0:1787384615.174941:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173968256 00000100:00100000:2.0:1787384615.175191:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:2.0:1787384615.175203:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:14379:x1874208173968256:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384615.175249:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384615.175277:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c484f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791c0 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.175360:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c4856 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.175376:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c4856 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.175390:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c4856 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.175408:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c485d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.175426:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c485d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.175434:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c485d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.175850:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4864 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176315:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176329:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384615.176412:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787384615.176440:0:14174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384615.176473:0:14174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4864 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176488:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c4856 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176495:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c4856 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176502:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c4856 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176508:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384615.176512:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c4856 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176519:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c4856 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176532:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34a25fe00) 00010000:00010000:2.0:1787384615.176535:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384615.176539:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c4856 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176546:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c4856 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176561:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c485d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176568:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c485d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176585:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c485d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176591:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384615.176593:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c485d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176600:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c485d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176608:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e345695800) 00010000:00010000:2.0:1787384615.176611:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384615.176614:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c485d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176620:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c485d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176662:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c484f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791c0 expref: 8 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176676:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4864 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791c0 expref: 7 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.176683:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e345695a00) 00010000:00010000:2.0:1787384615.176685:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384615.176687:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2000, rc 0) 00000100:00100000:2.0:1787384615.180358:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373362a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+7:14379:x1874208173968256:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 5145us (11572us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384615.180391:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 22 00000100:00100000:2.0:1787384615.193254:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384615.196127:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173968512 00000100:00100000:0.0:1787384615.196210:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173968512 00000100:00100000:0.0:1787384615.196459:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:0.0:1787384615.196473:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+7:14379:x1874208173968512:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384615.196515:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384615.196546:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c486b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791c7 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384615.196706:0:14175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787384615.196889:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c486b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791c7 expref: 9 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.196908:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34a25fe00) 00010000:00010000:0.0:1787384615.196911:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787384615.196916:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c486b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791c7 expref: 9 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.196934:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ae00, rc 0) 00000100:00100000:0.0:1787384615.197016:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+8:14379:x1874208173968512:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 547us (3776us total) trans 8589934595 rc 301/301 00000100:00100000:0.0:1787384615.197025:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 23 00000100:00100000:1.0:1787384615.204084:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384615.204305:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173968768 00000100:00100000:0.0:1787384615.204320:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173968768 00000100:00100000:0.0:1787384615.204445:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:0.0:1787384615.204457:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+8:14379:x1874208173968768:12345-192.168.203.51@tcp:36:lfs.0 00010000:00010000:0.0:1787384615.204565:0:14833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384615.204600:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4864 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791c0 expref: 8 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.204628:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e345695a00) 00010000:00010000:0.0:1787384615.204645:0:14833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384615.204679:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.204695:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.204707:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384615.205040:0:14833:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000032d5b47f reply state 00000000c7cc0d1c transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384615.205052:0:14833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1787384615.205067:0:14833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1787384615.205188:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373361f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+9:14379:x1874208173968768:12345-192.168.203.51@tcp:36:lfs.0 Request processed in 732us (1120us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787384615.205197:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 24 00000100:00100000:1.0:1787384615.210105:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00010000:00010000:1.0:1787384615.210184:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.210199:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.210208:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.210214:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108aa00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384615.210220:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.210228:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.210276:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e343ce4a00) 00010000:00010000:1.0:1787384615.210279:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1787384615.210284:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.210291:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108aa00/0x3522fbed3b6c4879 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384615.212105:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173969024 00000100:00100000:2.0:1787384615.212127:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173969024 00000100:00100000:2.0:1787384615.212223:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:2.0:1787384615.212235:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+8:14379:x1874208173969024:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1787384615.212797:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+9:14379:x1874208173969024:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 561us (2703us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1787384615.212807:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:1.0:1787384615.226484:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.226654:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173969280 00000100:00100000:3.0:1787384615.226668:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173969280 00000100:00100000:3.0:1787384615.226796:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:3.0:1787384615.226809:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+9:14379:x1874208173969280:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:3.0:1787384615.226844:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384615.226904:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c4880 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791ce expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227013:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4887 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227030:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227043:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227061:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c488e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227067:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c488e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227074:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c488e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384615.227345:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787384615.227474:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4887 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227483:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4887 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227489:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227496:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fc400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384615.227501:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4887 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227623:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4887 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227640:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34a25fe00) 00010000:00010000:3.0:1787384615.227644:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384615.227650:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4887 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227657:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4887 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227673:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c488e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227680:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c488e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227696:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c488e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227702:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fd200 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384615.227705:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c488e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227712:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c488e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227721:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e34a25fd00) 00010000:00010000:3.0:1787384615.227724:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384615.227727:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c488e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227733:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c488e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227779:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c4880 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ce expref: 11 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227792:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34a25fe00) 00010000:00010000:3.0:1787384615.227795:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787384615.227798:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c4880 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ce expref: 11 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.227809:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fc200, rc 0) 00000100:00100000:3.0:1787384615.227932:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373361880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+10:14379:x1874208173969280:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1124us (1463us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787384615.230751:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 25 00000100:00100000:1.0:1787384615.231219:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384615.231341:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173969408 00000100:00100000:2.0:1787384615.231354:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173969408 00000100:00100000:2.0:1787384615.231423:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:2.0:1787384615.231435:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+10:14379:x1874208173969408:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384615.231466:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384615.231495:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c489c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791d5 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.231807:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.231824:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.231838:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384615.232072:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787384615.232094:0:14174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384615.232126:0:14174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.232231:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c489c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791d5 expref: 12 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.232317:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791d5 expref: 11 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.232329:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e345695800) 00010000:00010000:2.0:1787384615.232332:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787384615.232337:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2200, rc 0) 00000100:00100000:2.0:1787384615.232464:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373362d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+11:14379:x1874208173969408:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1030us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384615.232473:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 26 00000100:00100000:1.0:1787384615.238413:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384615.238644:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173969536 00000100:00100000:2.0:1787384615.238659:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173969536 00000100:00100000:2.0:1787384615.238730:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:2.0:1787384615.238742:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+11:14379:x1874208173969536:12345-192.168.203.51@tcp:37:lfs.0 00010000:00010000:0.0:1787384615.242147:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787384615.245259:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+11:14379:x1874208173969536:12345-192.168.203.51@tcp:37:lfs.0 Request processed in 6501us (6845us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384615.245278:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:1.0:1787384615.248769:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384615.248923:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173969792 00000100:00100000:2.0:1787384615.248936:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173969792 00000100:00100000:2.0:1787384615.249008:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:2.0:1787384615.249020:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e347827450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+11:14379:x1874208173969792:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:2.0:1787384615.249745:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e347827450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+12:14379:x1874208173969792:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 722us (985us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787384615.249772:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:1.0:1787384615.291079:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.291623:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173969920 00000100:00100000:3.0:1787384615.291639:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173969920 00000100:00100000:0.0:1787384615.291941:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:0.0:1787384615.292041:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+10:14385:x1874208173969920:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1787384615.292070:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384615.292098:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c48aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791dc expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292222:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48b1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292255:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292270:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292286:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48b8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292293:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292301:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292453:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c48bf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292463:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c48bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292471:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c48bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384615.292532:0:14175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1787384615.292537:0:14175:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787384615.292589:0:14175:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c48bf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292615:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48b1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292621:0:14175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48b1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292627:0:14175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292633:0:14175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384615.292637:0:14175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48b1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292646:0:14175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48b1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292659:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34a25fe00) 00010000:00010000:0.0:1787384615.292663:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384615.292669:0:14175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48b1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292675:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48b1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292690:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48b8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292696:0:14175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48b8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292703:0:14175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292715:0:14175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384615.292718:0:14175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48b8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292724:0:14175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48b8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292732:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff89e343ce4200) 00010000:00010000:0.0:1787384615.292735:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384615.292737:0:14175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48b8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292744:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48b8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292793:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c48aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791dc expref: 12 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292809:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ac00/0x3522fbed3b6c48bf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791dc expref: 11 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.292817:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e345695800) 00010000:00010000:0.0:1787384615.292819:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787384615.292822:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ac00, rc 0) 00000100:00100000:0.0:1787384615.292972:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373361180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+11:14385:x1874208173969920:12345-192.168.203.51@tcp:101:bash.0 Request processed in 934us (1908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384615.294929:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 27 00000100:00100000:1.0:1787384615.300391:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384615.300536:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173970176 00000100:00100000:0.0:1787384615.300563:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173970176 00000100:00100000:0.0:1787384615.300687:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 28 00000100:00100000:0.0:1787384615.300709:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+11:14385:x1874208173970176:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:0.0:1787384615.300738:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384615.300773:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c48c6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791e3 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.300999:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.301016:0:14833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791d5 expref: 11 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.301028:0:14833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.301073:0:14833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791d5 expref: 11 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.301089:0:14833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791d5 expref: 11 pid: 14174 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384615.301105:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e241330380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14833:1874208195978880:192.168.203.51@tcp:104: 00000100:00100000:0.0:1787384615.301221:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e346183480 going to sleep for 11 seconds 00000100:00100000:1.0:1787384615.306103:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384615.306225:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e241330380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:14833:1874208195978880:192.168.203.51@tcp:104: 00010000:00010000:0.0:1787384615.306382:0:14833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384615.306661:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173970304 00000100:00100000:3.0:1787384615.306670:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173970304 00010000:00010000:3.0:1787384615.306971:0:14159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791d5 expref: 12 pid: 14174 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384615.307022:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:3.0:1787384615.307034:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+12:2353:x1874208173970304:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384615.307055:0:14159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384615.307064:0:14159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791d5 expref: 12 pid: 14174 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.307077:0:14159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791d5 expref: 12 pid: 14174 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.307106:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c48a3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791d5 expref: 12 pid: 14174 timeout: 576 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.307127:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e345695800) 00010000:00010000:3.0:1787384615.307132:0:14159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.307143:0:14159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.307151:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.307188:0:14159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384615.307408:0:14833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.307427:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.307457:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.307468:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.307476:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384615.308735:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+11:2353:x1874208173970304:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 1690us (2633us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384615.308752:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00010000:00010000:0.0:1787384615.309815:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.309842:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.309855:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384615.309908:0:14833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787384615.309944:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.309952:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.309960:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.309976:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384615.309981:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.309989:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.310004:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e345695800) 00010000:00010000:0.0:1787384615.310007:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384615.310012:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.310018:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c48cd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384615.310034:0:14833:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006684b82f reply state 00000000a44b9127 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384615.310044:0:14833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1787384615.310090:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ae00/0x3522fbed3b6c48c6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791e3 expref: 14 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.310107:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791e3 expref: 13 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.310116:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:0.0:1787384615.310119:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:0.0:1787384615.310121:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108ba00, rc 0) 00000100:00100000:0.0:1787384615.310199:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373361c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+14:14385:x1874208173970176:12345-192.168.203.51@tcp:101:bash.0 Request processed in 9502us (9821us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1787384615.310217:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 28 00010000:00010000:3.0:1787384615.316230:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.316255:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.316264:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.316270:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108b400 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384615.316276:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.316285:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.316307:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff89e343ce4200) 00010000:00010000:3.0:1787384615.316310:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384615.316316:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.316323:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108b400/0x3522fbed3b6c48d4 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384615.341481:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384615.344360:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173970432 00000100:00100000:2.0:1787384615.344381:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173970432 00000100:00100000:2.0:1787384615.344551:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:2.0:1787384615.344563:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+13:14385:x1874208173970432:12345-192.168.203.51@tcp:101:bash.0 00010000:00010000:2.0:1787384615.344596:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384615.344643:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c48e9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791ea expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.344848:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.344886:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.344901:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384615.344955:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787384615.344961:0:14173:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384615.344988:0:14173:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.345000:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.345029:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c48e9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ea expref: 15 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.345054:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ea expref: 14 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.345083:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:2.0:1787384615.345086:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384615.345091:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3000, rc 0) 00000100:00100000:2.0:1787384615.345201:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+14:14385:x1874208173970432:12345-192.168.203.51@tcp:101:bash.0 Request processed in 640us (3733us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384615.345210:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 29 00000100:00100000:1.0:1787384615.349192:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.349340:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173970688 00000100:00100000:3.0:1787384615.349354:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173970688 00000100:00100000:3.0:1787384615.349455:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:3.0:1787384615.349468:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+14:14385:x1874208173970688:12345-192.168.203.51@tcp:35:bash.0 00000100:00100000:3.0:1787384615.350367:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+15:14385:x1874208173970688:12345-192.168.203.51@tcp:35:bash.0 Request processed in 896us (1184us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787384615.350380:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:1.0:1787384615.447912:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384615.448201:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173970944 00000100:00100000:2.0:1787384615.448215:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173970944 00000100:00100000:2.0:1787384615.448439:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:2.0:1787384615.448452:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+15:14395:x1874208173970944:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:2.0:1787384615.448486:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384615.448524:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c48f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791f1 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384615.448686:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787384615.448842:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c48f7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791f1 expref: 17 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.448912:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff89e34a25fe00) 00010000:00010000:2.0:1787384615.448916:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384615.448923:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c48f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791f1 expref: 17 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.448941:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb3c00, rc 0) 00000100:00100000:3.0:1787384615.449741:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373362680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+16:14395:x1874208173970944:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1286us (1886us total) trans 8589934602 rc 301/301 00000100:00100000:3.0:1787384615.449752:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:1.0:1787384615.453493:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.453735:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173971200 00000100:00100000:3.0:1787384615.453747:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173971200 00000100:00100000:3.0:1787384615.453847:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:3.0:1787384615.453890:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e373360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+16:14395:x1874208173971200:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:3.0:1787384615.454407:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e373360e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+17:14395:x1874208173971200:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 549us (928us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787384615.454425:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:1.0:1787384615.493620:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384615.494093:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173971456 00000100:00100000:0.0:1787384615.494107:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173971456 00000100:00100000:0.0:1787384615.494195:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:0.0:1787384615.494207:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+17:14398:x1874208173971456:12345-192.168.203.51@tcp:101:lfs.0 00010000:00010000:0.0:1787384615.494369:0:14175:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787384615.494399:0:14175:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c4905 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791f8 expref: -99 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.494622:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c490c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.494640:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c490c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.494653:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c490c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384615.494667:0:14175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787384615.494837:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c4905 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791f8 expref: 20 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.494921:0:14175:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c490c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791f8 expref: 19 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.494932:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:0.0:1787384615.494935:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787384615.494939:0:14175:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e35108a400, rc 0) 00000100:00100000:0.0:1787384615.495352:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+19:14398:x1874208173971456:12345-192.168.203.51@tcp:101:lfs.0 Request processed in 1145us (1745us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787384615.495362:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:0.0:1787384615.503023:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384615.503072:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.503183:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173971584 00000100:00100000:3.0:1787384615.503196:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173971584 00000100:00100000:3.0:1787384615.503632:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:3.0:1787384615.503645:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+19:2353:x1874208173971584:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384615.503666:0:14158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384615.503700:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a400/0x3522fbed3b6c490c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791f8 expref: 19 pid: 14175 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.503723:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:3.0:1787384615.503728:0:14158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384615.503822:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241330380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+18:2353:x1874208173971584:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 180us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384615.503831:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1787384615.505639:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173971712 00000100:00100000:2.0:1787384615.505658:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173971712 00000100:00100000:2.0:1787384615.505784:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:2.0:1787384615.505796:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+18:14398:x1874208173971712:12345-192.168.203.51@tcp:54:lfs.0 00010000:00010000:2.0:1787384615.505913:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c491a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.505934:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c491a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.505959:0:14833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c491a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.505994:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c491a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.506003:0:14833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c491a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.506010:0:14833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c491a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.506017:0:14833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384615.506022:0:14833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c491a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.506031:0:14833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c491a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.506044:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:2.0:1787384615.506048:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787384615.506053:0:14833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c491a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.506072:0:14833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c491a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384615.506168:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+18:14398:x1874208173971712:12345-192.168.203.51@tcp:54:lfs.0 Request processed in 375us (3094us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384615.506177:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 32 00000100:00100000:0.0:1787384615.508856:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384615.508979:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173971968 00000100:00100000:1.0:1787384615.508991:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173971968 00000100:00100000:1.0:1787384615.509053:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:1.0:1787384615.509065:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+18:14398:x1874208173971968:12345-192.168.203.51@tcp:35:lfs.0 00000100:00100000:1.0:1787384615.509631:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241332a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+19:14398:x1874208173971968:12345-192.168.203.51@tcp:35:lfs.0 Request processed in 563us (785us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1787384615.509643:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000040:00080000:3.0:1787384615.689549:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787384615.827363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384615.828682:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173972224 00000100:00100000:2.0:1787384615.828703:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173972224 00000100:00100000:2.0:1787384615.828853:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:2.0:1787384615.828881:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e241331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+19:14429:x1874208173972224:12345-192.168.203.51@tcp:101:cat.0 00010000:00010000:2.0:1787384615.828913:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384615.828953:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4921 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee791ff expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.829106:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4928 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.829135:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.829152:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384615.829167:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1787384615.829361:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4921 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ff expref: 22 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.829385:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4928 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ff expref: 21 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.829422:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:2.0:1787384615.829426:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787384615.829431:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2600, rc 0) 00000100:00100000:2.0:1787384615.829925:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e241331c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+21:14429:x1874208173972224:12345-192.168.203.51@tcp:101:cat.0 Request processed in 1045us (2575us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1787384615.829935:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 33 00000100:00100000:0.0:1787384615.835731:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384615.835925:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384615.836141:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173972480 00000100:00100000:1.0:1787384615.836154:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173972480 00000100:00100000:1.0:1787384615.836224:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:1.0:1787384615.836236:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+21:14429:x1874208173972480:12345-192.168.203.51@tcp:35:cat.0 00000100:00100000:3.0:1787384615.836615:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173972608 00000100:00100000:3.0:1787384615.836621:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173972608 00000100:00100000:3.0:1787384615.836669:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:3.0:1787384615.836678:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+22:2353:x1874208173972608:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384615.836697:0:14159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384615.836730:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4928 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ff expref: 22 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.836754:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:3.0:1787384615.836760:0:14159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384615.836835:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+21:2353:x1874208173972608:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 158us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384615.836844:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:1.0:1787384615.838486:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+21:14429:x1874208173972480:12345-192.168.203.51@tcp:35:cat.0 Request processed in 2242us (2758us total) trans 8589934607 rc 0/0 00000100:00100000:1.0:1787384615.838521:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 8 00000100:00100000:0.0:1787384615.928247:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.928673:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173972864 00000100:00100000:3.0:1787384615.928687:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173972864 00000100:00100000:3.0:1787384615.928818:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:3.0:1787384615.928831:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+21:14435:x1874208173972864:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:3.0:1787384615.928909:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384615.928937:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c4936 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79206 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.929092:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.929143:0:14174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791e3 expref: 22 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.929153:0:14174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ea expref: 22 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.929162:0:14174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.929206:0:14174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ea expref: 22 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.929221:0:14174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ea expref: 22 pid: 14173 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384615.929237:0:14174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14174:1874208195979008:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384615.929823:0:14174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791e3 expref: 22 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.929835:0:14174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791e3 expref: 22 pid: 14833 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384615.929844:0:14174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14174:1874208195979136:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384615.932194:0:14174:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aef000 going to sleep for 11 seconds 00000100:00100000:0.0:1787384615.932636:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.932770:0:14174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14174:1874208195979008:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384615.932783:0:14174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14174:1874208195979136:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384615.932836:0:14174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384615.932962:0:14158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173972992 00000100:00100000:1.0:1787384615.932971:0:14158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173972992 00010000:00010000:1.0:1787384615.933025:0:14158:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ea expref: 23 pid: 14173 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384615.933070:0:14158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:1.0:1787384615.933082:0:14158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e351fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+23:2353:x1874208173972992:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384615.933103:0:14158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384615.933111:0:14158:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ea expref: 23 pid: 14173 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.933125:0:14158:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ea expref: 23 pid: 14173 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.933153:0:14158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c48f0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791ea expref: 23 pid: 14173 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.933173:0:14158:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:1.0:1787384615.933178:0:14158:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.933199:0:14158:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.933207:0:14158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787384615.933533:0:14158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e351fc5050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+22:2353:x1874208173972992:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 450us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384615.933543:0:14158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:0.0:1787384615.937111:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.937244:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173973120 00000100:00100000:3.0:1787384615.937376:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173973120 00010000:00010000:3.0:1787384615.937444:0:14159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791e3 expref: 22 pid: 14833 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384615.937581:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:3.0:1787384615.937594:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+22:2353:x1874208173973120:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384615.937613:0:14159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384615.937622:0:14159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791e3 expref: 22 pid: 14833 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.937638:0:14159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791e3 expref: 22 pid: 14833 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.937666:0:14159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108ba00/0x3522fbed3b6c48db lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee791e3 expref: 22 pid: 14833 timeout: 577 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.937687:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:3.0:1787384615.937693:0:14159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.937703:0:14159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.937711:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.937804:0:14159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384615.937906:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+21:2353:x1874208173973120:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 314us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384615.937914:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00010000:00010000:0.0:1787384615.938883:0:14174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.938900:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787384615.938928:0:14174:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1787384615.939692:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc200/0x3522fbed3b6c4936 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79206 expref: 22 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.939719:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd200/0x3522fbed3b6c493d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79206 expref: 21 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.939728:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:0.0:1787384615.939731:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787384615.939735:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fd200, rc 0) 00000100:00100000:0.0:1787384615.939825:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+21:14435:x1874208173972864:12345-192.168.203.51@tcp:101:dd.0 Request processed in 10995us (11591us total) trans 8589934608 rc 0/0 00000100:00100000:0.0:1787384615.939852:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 34 00000100:00100000:0.0:1787384615.947092:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384615.947258:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173973376 00000100:00100000:2.0:1787384615.947271:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173973376 00000100:00100000:2.0:1787384615.947360:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 35 00000100:00100000:2.0:1787384615.947372:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+21:14435:x1874208173973376:12345-192.168.203.51@tcp:36:dd.0 00010000:00010000:2.0:1787384615.947746:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.947768:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.947781:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384615.947838:0:14175:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1787384615.947912:0:14175:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009a65729c reply state 0000000029c44aff transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384615.947922:0:14175:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384615.948148:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14435:x1874208173973376:12345-192.168.203.51@tcp:36:dd.0 Request processed in 777us (1071us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1787384615.948157:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 35 00000020:00080000:2.0:1787384615.948180:0:14175:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787384615.951681:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.951703:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.951712:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.951718:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:0.0:1787384615.951723:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.951732:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.951753:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:0.0:1787384615.951756:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787384615.951760:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384615.951767:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c494b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384615.953878:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384615.955557:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173973504 00000100:00100000:1.0:1787384615.955577:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173973504 00000100:00100000:1.0:1787384615.955669:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:1.0:1787384615.955682:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+23:14435:x1874208173973504:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:1.0:1787384615.955715:0:14833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384615.955742:0:14833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c4952 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7920d expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.955824:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c4952 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7920d expref: 24 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.955843:0:14833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c4952 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7920d expref: 24 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384615.955924:0:14833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:1.0:1787384615.955929:0:14833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787384615.955933:0:14833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624cc00, rc 0) 00000100:00100000:1.0:1787384615.956581:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14435:x1874208173973504:12345-192.168.203.51@tcp:101:dd.0 Request processed in 897us (2731us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384615.956592:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 36 00000100:00100000:1.0:1787384615.983001:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.983106:0:16194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173973760 00000100:00100000:3.0:1787384615.983120:0:16194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173973760 00000100:00100000:3.0:1787384615.983201:0:16194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:3.0:1787384615.983213:0:16194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14435:x1874208173973760:12345-192.168.203.51@tcp:103:dd.0 00010000:00010000:3.0:1787384615.983232:0:16194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384615.983288:0:16194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624cc00/0x3522fbed3b6c4952 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7920d expref: 24 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.983312:0:16194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:3.0:1787384615.983319:0:16194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384615.983385:0:16194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+23:14435:x1874208173973760:12345-192.168.203.51@tcp:103:dd.0 Request processed in 174us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384615.983394:0:16194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:0.0:1787384615.991029:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384615.991207:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173973888 00000100:00100000:2.0:1787384615.991220:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173973888 00000100:00100000:2.0:1787384615.991306:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:2.0:1787384615.991317:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+23:14435:x1874208173973888:12345-192.168.203.51@tcp:58:dd.0 00010000:00010000:2.0:1787384615.991457:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.991478:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384615.991492:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384615.992626:0:14175:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787384615.992812:0:14175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1787384615.992971:0:14175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1787384615.993130:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+23:14435:x1874208173973888:12345-192.168.203.51@tcp:58:dd.0 Request processed in 1806us (2108us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384615.993142:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 37 00000100:00100000:0.0:1787384615.997362:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384615.997535:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173974016 00000100:00100000:3.0:1787384615.997549:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173974016 00000100:00100000:3.0:1787384615.997633:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 38 00000100:00100000:3.0:1787384615.997647:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+23:14435:x1874208173974016:12345-192.168.203.51@tcp:101:dd.0 00010000:00010000:3.0:1787384615.997676:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384615.997703:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4960 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79214 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.997779:0:14174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.997811:0:14174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4960 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79214 expref: 24 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.997837:0:14174:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.997853:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4960 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79214 expref: 24 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.997919:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:3.0:1787384615.997923:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384615.997927:0:14174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4960 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79214 expref: 24 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384615.997935:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fc400, rc 0) 00000100:00100000:3.0:1787384615.998006:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14435:x1874208173974016:12345-192.168.203.51@tcp:101:dd.0 Request processed in 362us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384615.998014:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 38 00010000:00010000:2.0:1787384616.265301:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787384616.521581:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787384616.521631:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195979264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787384616.521727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384616.522756:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3306:1874208195979392:0@lo:400:kworker.0 00000100:00100000:2.0:1787384616.522796:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195979648:0@lo:400:kworker.0 00000100:00100000:3.0:1787384616.522827:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384616.522846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384616.522908:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195979904:0@lo:400:kworker.0 00000100:00100000:2.0:1787384616.522915:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787384616.522925:0:3304:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195979776:0@lo:400:kworker.0 00000100:00100000:3.0:1787384616.522952:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384616.522975:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787384616.522979:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787384616.522985:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195979520:0@lo:400:kworker.0 00000100:00100000:2.0:1787384616.523021:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195979648 00000100:00100000:3.0:1787384616.523022:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384616.523033:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195979648 00000100:00100000:3.0:1787384616.523064:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195979520 00000100:00100000:3.0:1787384616.523088:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195979520 00000100:00100000:2.0:1787384616.523096:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195979904 00000100:00100000:0.0:1787384616.523214:0:14168:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195979392 00000100:00100000:0.0:1787384616.523219:0:14168:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195979392 00000100:00100000:0.0:1787384616.523266:0:14168:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787384616.523278:0:14168:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3306:x1874208195979392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384616.523343:0:14168:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374903450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a0a21a99-396b-46a4-a5fe-afbe14b55ea8+19:3306:x1874208195979392:12345-0@lo:400:kworker.0 Request processed in 67us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384616.523350:0:14168:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1787384616.523392:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195979776 00000100:00100000:0.0:1787384616.523396:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195979776 00000100:00100000:0.0:1787384616.523428:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384616.523436:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195979648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384616.523480:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1874208195979648:12345-0@lo:400:kworker.0 Request processed in 45us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384616.523486:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787384616.523510:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787384616.523517:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195979776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787384616.523545:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1874208195979776:12345-0@lo:400:kworker.0 Request processed in 29us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384616.523552:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1787384616.523590:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787384616.523597:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384616.523645:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3304:1874208195979776:0@lo:400:kworker.0 00000100:00100000:0.0:1787384616.523657:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3304:1874208195979648:0@lo:400:kworker.0 00000100:00100000:0.0:1787384616.523697:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:a0a21a99-396b-46a4-a5fe-afbe14b55ea8:3306:1874208195979392:0@lo:400:kworker.0 00000100:00100000:2.0:1787384616.523769:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195979904 00000100:00100000:2.0:1787384616.523825:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787384616.523832:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195979904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787384616.523889:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3306:x1874208195979904:12345-0@lo:400:kworker.0 Request processed in 58us (936us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384616.523896:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787384616.523920:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3306:1874208195979904:0@lo:400:kworker.0 00000100:00100000:1.0:1787384616.525090:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195979264 00000100:00100000:1.0:1787384616.525112:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195979264 00000100:00100000:3.0:1787384616.525157:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787384616.525176:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195979520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787384616.525179:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787384616.525192:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195979264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787384616.525233:0:14812:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787384616.525271:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195979520:12345-0@lo:400:kworker.0 Request processed in 103us (2249us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384616.525280:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787384616.525294:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1874208195979264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (3567us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384616.525302:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787384616.525337:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195979520:0@lo:400:kworker.0 00000100:00100000:1.0:1787384616.525366:0:3304:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c5ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3304:1874208195979264:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787384616.526605:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787384616.526616:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1787384616.713216:0:14208:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787384616.713240:0:14208:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384616.713288:0:14208:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787384616.713298:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787384616.713485:0:14208:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14208:1874208195980032:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787384616.713726:0:14208:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e347aefcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787384616.723139:0:14208:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14208:1874208195980032:192.168.203.51@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787384616.730657:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384616.731287:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173974144 00000100:00100000:3.0:1787384616.731301:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173974144 00000100:00080000:0.0:1787384616.731443:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787384616.731506:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:3.0:1787384616.731520:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14436:x1874208173974144:12345-192.168.203.51@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1787384616.731647:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14436:x1874208173974144:12345-192.168.203.51@tcp:900:lhsmtool_posix.0 Request processed in 129us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384616.731655:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:0.0:1787384616.740030:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384616.740169:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173974272 00000100:00100000:3.0:1787384616.740182:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173974272 00000100:00100000:3.0:1787384616.740260:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:3.0:1787384616.740272:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14436:x1874208173974272:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787384616.740334:0:14174:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787384616.741089:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14436:x1874208173974272:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 816us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384616.741098:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 39 00000100:00100000:0.0:1787384616.745199:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.745745:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173974400 00000100:00100000:2.0:1787384616.745853:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173974400 00000100:00100000:2.0:1787384616.746107:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:2.0:1787384616.746120:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14436:x1874208173974400:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787384616.746222:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4967 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746243:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4967 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746256:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4967 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746459:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c496e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746481:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c496e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746494:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c496e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746529:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746551:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746559:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787384616.746606:0:14175:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787384616.746610:0:14175:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787384616.746641:0:14175:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746656:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4967 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746663:0:14175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4967 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746669:0:14175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4967 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746674:0:14175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384616.746678:0:14175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4967 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746684:0:14175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4967 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746696:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e34a25fa00) 00010000:00010000:2.0:1787384616.746700:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384616.746704:0:14175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4967 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746720:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c4967 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746736:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c496e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746742:0:14175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c496e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746749:0:14175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c496e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746754:0:14175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384616.746757:0:14175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c496e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746763:0:14175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c496e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746770:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff89e345695b00) 00010000:00010000:2.0:1787384616.746772:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384616.746775:0:14175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c496e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746779:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c496e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746796:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746802:0:14175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746815:0:14175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746820:0:14175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384616.746824:0:14175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746830:0:14175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746837:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:2.0:1787384616.746840:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384616.746842:0:14175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.746847:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c4975 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384616.747139:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14436:x1874208173974400:12345-192.168.203.51@tcp:34:lhsmtool_posix.0 Request processed in 1018us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384616.747151:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 40 00000100:00100000:0.0:1787384616.753024:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384616.753675:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173974656 00000100:00100000:1.0:1787384616.753690:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173974656 00000100:00100000:1.0:1787384616.753824:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:1.0:1787384616.753837:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+24:14436:x1874208173974656:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787384616.753911:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787384616.753941:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c497c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7921b expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754076:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c4983 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754094:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c4983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754107:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c4983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787384616.754122:0:14173:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787384616.754285:0:14173:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c4983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754293:0:14173:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c4983 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754299:0:14173:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c4983 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754305:0:14173:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624d000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384616.754310:0:14173:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c4983 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754318:0:14173:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c4983 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754331:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:1.0:1787384616.754334:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787384616.754692:0:14173:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c4983 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754703:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624d000/0x3522fbed3b6c4983 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754780:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c497c lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7921b expref: 26 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754792:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff89e34a25fa00) 00010000:00010000:1.0:1787384616.754794:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787384616.754799:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624da00/0x3522fbed3b6c497c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7921b expref: 26 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.754822:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e36624da00, rc 0) 00000100:00100000:1.0:1787384616.755123:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+25:14436:x1874208173974656:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 1287us (2106us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1787384616.755133:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 41 00000100:00100000:0.0:1787384616.763254:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384616.763331:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173974784 00000100:00100000:1.0:1787384616.763429:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173974784 00000100:00100000:1.0:1787384616.763629:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:1.0:1787384616.763641:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+25:14436:x1874208173974784:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787384616.763696:0:14833:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787384616.763855:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+25:14436:x1874208173974784:12345-192.168.203.51@tcp:53:lhsmtool_posix.0 Request processed in 215us (608us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384616.764142:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 42 00000100:00100000:0.0:1787384616.771717:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384616.771801:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173975040 00000100:00100000:3.0:1787384616.771827:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173975040 00000100:00100000:3.0:1787384616.771927:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:3.0:1787384616.771938:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+25:14436:x1874208173975040:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384616.771958:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384616.771981:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4991 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79222 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787384616.772954:0:14174:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:3.0:1787384616.772963:0:14174:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1787384616.773011:0:14174:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787384616.773278:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fda00/0x3522fbed3b6c4998 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.773294:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fda00/0x3522fbed3b6c4998 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.773306:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fda00/0x3522fbed3b6c4998 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.774648:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4991 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79222 expref: 28 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.774675:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fda00/0x3522fbed3b6c4998 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79222 expref: 27 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.774698:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e34a25fd00) 00010000:00010000:3.0:1787384616.774701:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787384616.774704:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fda00, rc 0) 00000100:00100000:3.0:1787384616.774846:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+27:14436:x1874208173975040:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 2908us (3136us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787384616.774856:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 43 00000100:00100000:0.0:1787384616.783630:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.783737:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173975296 00000100:00100000:2.0:1787384616.783748:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173975296 00000100:00100000:2.0:1787384616.783819:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:2.0:1787384616.783830:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+27:14436:x1874208173975296:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787384616.783931:0:14175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384616.783958:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fda00/0x3522fbed3b6c4998 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79222 expref: 27 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.783993:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e34a25fd00) 00010000:00010000:2.0:1787384616.784004:0:14175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787384616.784026:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49a6 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784038:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784046:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784058:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49ad lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc26be119 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784066:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc26be119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784072:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc26be119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784142:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49a6 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784150:0:14175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49a6 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784156:0:14175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49a6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784162:0:14175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2600 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384616.784166:0:14175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49a6 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784178:0:14175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49a6 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784187:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff89e345695800) 00010000:00010000:2.0:1787384616.784190:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384616.784193:0:14175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49a6 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784532:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49a6 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784545:0:14175:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49ad lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc26be119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784551:0:14175:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49ad lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc26be119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784556:0:14175:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc26be119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784561:0:14175:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:2.0:1787384616.784564:0:14175:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49ad lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc26be119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784569:0:14175:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49ad lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xc26be119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784577:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xc26be119 (ffff89e345695b00) 00010000:00010000:2.0:1787384616.784580:0:14175:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787384616.784583:0:14175:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49ad lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc26be119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.784599:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49ad lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xc26be119 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384616.784961:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377969880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+26:14436:x1874208173975296:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 1130us (1338us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787384616.784970:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 44 00000100:00100000:1.0:1787384616.791530:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.791685:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173975424 00000100:00100000:2.0:1787384616.791695:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173975424 00000100:00100000:2.0:1787384616.791754:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:2.0:1787384616.791764:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+26:14436:x1874208173975424:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384616.791789:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384616.791813:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49b4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79229 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.791847:0:14173:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49bb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.791889:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.791901:0:14173:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49bb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14173 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.792012:0:14173:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79229 expref: 28 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.792030:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2600/0x3522fbed3b6c49bb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79229 expref: 27 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.792051:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e345695b00) 00010000:00010000:2.0:1787384616.792054:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787384616.792058:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2600, rc 0) 00000100:00100000:2.0:1787384616.792111:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+27:14436:x1874208173975424:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 348us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384616.792118:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 45 00000100:00100000:0.0:1787384616.798311:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.798531:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173975680 00000100:00100000:2.0:1787384616.798540:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173975680 00000100:00100000:2.0:1787384616.798651:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 46 00000100:00100000:2.0:1787384616.798662:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+27:14436:x1874208173975680:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787384616.798762:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.798777:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.798788:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787384616.799186:0:14175:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1787384616.799197:0:14175:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 477942336240ns, next at 478942333985ns, rc = 0 00000004:00010000:2.0:1787384616.799281:0:14175:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a9fdc64b reply state 00000000b0bc3307 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384616.799291:0:14175:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787384616.800616:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37796b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+29:14436:x1874208173975680:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 1949us (2305us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1787384616.800641:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 46 00010000:00010000:3.0:1787384616.802692:0:3291:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.802704:0:3291:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.802709:0:3291:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.802712:0:3291:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384616.802716:0:3291:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.802721:0:3291:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.802734:0:3291:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e345695b00) 00010000:00010000:3.0:1787384616.802736:0:3291:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787384616.802739:0:3291:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.802742:0:3291:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3c00/0x3522fbed3b6c49c2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384616.803316:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.803743:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173975808 00000100:00100000:2.0:1787384616.803752:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173975808 00000100:00100000:2.0:1787384616.803837:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:2.0:1787384616.803847:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+28:14436:x1874208173975808:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787384616.803893:0:14173:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787384616.803909:0:14173:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c49c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79230 expref: -99 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.803975:0:14173:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c49c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79230 expref: 29 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.803988:0:14173:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c49c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79230 expref: 29 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.804006:0:14173:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e345695b00) 00010000:00010000:2.0:1787384616.804009:0:14173:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787384616.804012:0:14173:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e379eb2200, rc 0) 00000100:00100000:2.0:1787384616.804074:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+29:14436:x1874208173975808:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 228us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384616.804081:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 47 00000100:00100000:0.0:1787384616.806712:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384616.806789:0:14808:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173975936 00000100:00100000:3.0:1787384616.806797:0:14808:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173975936 00000100:00100000:3.0:1787384616.806890:0:14808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00100000:3.0:1787384616.806900:0:14808:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e377968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2353:x1874208173975936:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787384616.807455:0:14808:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e377968380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:2353:x1874208173975936:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 554us (749us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787384616.807463:0:14808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 12 00000100:00080000:0.0:1787384616.807820:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787384616.810953:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.811039:0:14177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173976192 00000100:00100000:2.0:1787384616.811047:0:14177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173976192 00000100:00100000:2.0:1787384616.811091:0:14177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:2.0:1787384616.811100:0:14177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+29:14436:x1874208173976192:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787384616.811349:0:14177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+30:14436:x1874208173976192:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 248us (414us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1787384616.811364:0:14177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 9 00000100:00100000:1.0:1787384616.814326:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.814522:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173976448 00000100:00100000:2.0:1787384616.814531:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173976448 00000100:00100000:2.0:1787384616.814591:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:2.0:1787384616.814601:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+30:14436:x1874208173976448:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787384616.814702:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+30:14436:x1874208173976448:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 102us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384616.814710:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 48 00000100:00100000:0.0:1787384616.817644:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384616.817729:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173976576 00000100:00100000:3.0:1787384616.817739:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173976576 00000100:00100000:3.0:1787384616.817799:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:3.0:1787384616.817810:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+30:14436:x1874208173976576:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384616.817830:0:14174:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384616.817850:0:14174:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c49d0 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79237 expref: -99 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.817979:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd800/0x3522fbed3b6c49d7 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.817993:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd800/0x3522fbed3b6c49d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.818004:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd800/0x3522fbed3b6c49d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787384616.818040:0:14174:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787384616.818057:0:14174:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd800/0x3522fbed3b6c49d7 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.818095:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c49d0 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79237 expref: 32 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.818112:0:14174:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd800/0x3522fbed3b6c49d7 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79237 expref: 31 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.818132:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e345695b00) 00010000:00010000:3.0:1787384616.818136:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787384616.818140:0:14174:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fd800, rc 0) 00000100:00100000:3.0:1787384616.818349:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+31:14436:x1874208173976576:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 540us (713us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384616.818358:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 49 00000100:00100000:1.0:1787384616.822188:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384616.822305:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173976704 00000100:00100000:3.0:1787384616.822316:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173976704 00000100:00100000:3.0:1787384616.822380:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:3.0:1787384616.822390:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:2352:x1874208173976704:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384616.822419:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384616.822441:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fdc3140a/0x3522fbed3b6c49de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee7923e expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787384616.822469:0:14811:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a895328, blocks: 0x1 00010000:00010000:3.0:1787384616.822488:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=477s v=(0 0) 00010000:00010000:3.0:1787384616.822492:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384616.822502:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fdc3140a/0x3522fbed3b6c49de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7923e expref: 7 pid: 14811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.822542:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000fdc3140a/0x3522fbed3b6c49de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7923e expref: 7 pid: 14811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.822556:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fda00, rc 0) 00000100:00100000:3.0:1787384616.822777:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:2352:x1874208173976704:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 386us (598us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384616.822785:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:1.0:1787384616.830806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.831433:0:14833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173976960 00000100:00100000:2.0:1787384616.831444:0:14833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173976960 00000100:00100000:2.0:1787384616.831543:0:14833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:2.0:1787384616.831554:0:14833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+31:14436:x1874208173976960:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787384616.831661:0:14833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+31:14436:x1874208173976960:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 108us (863us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384616.831669:0:14833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 50 00000100:00100000:0.0:1787384616.835350:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.835430:0:14173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173977088 00000100:00100000:2.0:1787384616.835440:0:14173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173977088 00000100:00100000:2.0:1787384616.835499:0:14173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 51 00000100:00100000:2.0:1787384616.835511:0:14173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+31:14436:x1874208173977088:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1787384616.885960:0:14173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+31:14436:x1874208173977088:12345-192.168.203.51@tcp:44:lhsmtool_posix.0 Request processed in 50440us (50617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384616.885973:0:14173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 51 00000001:00080000:1.0:1787384616.887090:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934608 is committed 00000001:00080000:1.0:1787384616.887109:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:1.0:1787384616.887177:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:1.0:1787384616.887191:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:1.0:1787384616.887198:0:5806:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:1.0:1787384616.887231:0:5806:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1787384616.887546:0:3306:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787384616.887643:0:3306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195980160:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787384616.887702:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787384616.888400:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.889075:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195980160 00000100:00100000:2.0:1787384616.889086:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195980160 00000100:00100000:2.0:1787384616.889141:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173977216 00000100:00100000:2.0:1787384616.889145:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173977216 00000100:00100000:2.0:1787384616.889172:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787384616.889181:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3306:x1874208195980160:12345-0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787384616.889481:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:0.0:1787384616.889490:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:2353:x1874208173977216:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1787384616.889573:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:2353:x1874208173977216:12345-192.168.203.51@tcp:16:lhsmtool_posix.0 Request processed in 84us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384616.889580:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00002000:00010000:2.0:1787384616.889987:0:16306:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1787384616.889991:0:16306:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1787384616.889993:0:16306:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1787384616.889994:0:16306:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787384616 -> 1787384616 00002000:00010000:2.0:1787384616.889996:0:16306:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1787384616.890039:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1874208195980160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 859us (2336us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1787384616.890045:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:0.0:1787384616.890224:0:3306:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff89e3460e2300/2, rc 0, transno 8589934595 00000100:00100000:0.0:1787384616.890230:0:3306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3306:1874208195980160:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1787384616.904637:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384616.904715:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173977472 00000100:00100000:0.0:1787384616.904736:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173977472 00000100:00100000:0.0:1787384616.904808:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:0.0:1787384616.904819:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+14:14436:x1874208173977472:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787384616.904888:0:14175:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787384616.904916:0:14175:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fd800/0x3522fbed3b6c49d7 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79237 expref: 14 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384616.904950:0:14175:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e345695b00) 00010000:00010000:0.0:1787384616.904956:0:14175:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787384616.904986:0:14175:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384616.904999:0:14175:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384616.905009:0:14175:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787384616.905191:0:14175:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005314e74a reply state 00000000836e6a41 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384616.905201:0:14175:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787384616.905298:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+15:14436:x1874208173977472:12345-192.168.203.51@tcp:36:lhsmtool_posix.0 Request processed in 480us (671us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1787384616.905306:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 52 00000100:00100000:0.0:1787384616.908812:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384616.909077:0:14811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173977600 00000100:00100000:3.0:1787384616.909086:0:14811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173977600 00000100:00100000:3.0:1787384616.909141:0:14811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:3.0:1787384616.909151:0:14811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:14436:x1874208173977600:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787384616.909168:0:14811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787384616.909184:0:14811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x75de5bb77ee79245 expref: -99 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.909214:0:14811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fdc3140a/0x3522fbed3b6c49de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7923e expref: 8 pid: 14811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.909240:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787384616.909245:0:14811:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384616.909251:0:14811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 8 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.909282:0:14811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fdc3140a/0x3522fbed3b6c49de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7923e expref: 8 pid: 14811 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.909294:0:14811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fdc3140a/0x3522fbed3b6c49de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7923e expref: 8 pid: 14811 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384616.909309:0:14811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14811:1874208195980288:192.168.203.51@tcp:104: 00000100:00100000:3.0:1787384616.909396:0:14811:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2af840 going to sleep for 11 seconds 00010000:00010000:1.0:1787384616.909662:0:3290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.909682:0:3290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.909689:0:3290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.909694:0:3290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108a000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:1.0:1787384616.909699:0:3290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.909707:0:3290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.909722:0:3290:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e345695b00) 00010000:00010000:1.0:1787384616.909725:0:3290:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787384616.909728:0:3290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.909734:0:3290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e35108a000/0x3522fbed3b6c49e5 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384616.916688:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.918827:0:14160:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173977728 00000100:00100000:2.0:1787384616.919057:0:14160:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173977728 00010000:00010000:2.0:1787384616.919100:0:14160:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fdc3140a/0x3522fbed3b6c49de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7923e expref: 9 pid: 14811 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384616.919145:0:14160:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:2.0:1787384616.919154:0:14160:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:2353:x1874208173977728:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787384616.919167:0:14160:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787384616.919185:0:14160:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fdc3140a/0x3522fbed3b6c49de lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7923e expref: 9 pid: 14811 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.919198:0:14160:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fdc3140a/0x3522fbed3b6c49de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7923e expref: 9 pid: 14811 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.919220:0:14160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384616.919224:0:14160:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384616.919230:0:14160:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 9 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.919250:0:14160:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 9 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.919283:0:14160:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 9 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384616.919298:0:14160:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14160:1874208195980416:192.168.203.51@tcp:105: 00000100:00100000:2.0:1787384616.919375:0:14160:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344099180 going to sleep for 11 seconds 00010000:00010000:3.0:1787384616.920571:0:14811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fdc3140a/0x3522fbed3b6c49de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee7923e expref: 9 pid: 14811 timeout: 578 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384616.920592:0:14811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:14811:1874208195980288:192.168.203.51@tcp:104: 00010000:00010000:3.0:1787384616.920614:0:14811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 8 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.920627:0:14811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff89e37b8fde00, rc 0) 00000100:00100000:3.0:1787384616.920690:0:14811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+8:14436:x1874208173977600:12345-192.168.203.51@tcp:101:lhsmtool_posix.0 Request processed in 11541us (11886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384616.920710:0:14811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 16 00000100:00100000:2.0:1787384616.923645:0:14160:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e3800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:14160:1874208195980416:192.168.203.51@tcp:105: 00010000:00010000:2.0:1787384616.923675:0:14160:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384616.923845:0:14160:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:2353:x1874208173977728:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 4690us (7163us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384616.923855:0:14160:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 13 00000100:00100000:2.0:1787384616.931401:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384616.931483:0:14809:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173977856 00000100:00100000:1.0:1787384616.931493:0:14809:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173977856 00000100:00100000:1.0:1787384616.931552:0:14809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:1.0:1787384616.931564:0:14809:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:2352:x1874208173977856:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787384616.931768:0:14809:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1787384616.931772:0:14809:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787384615 00002000:00010000:1.0:1787384616.931774:0:14809:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787384614 00002000:00010000:1.0:1787384616.931788:0:14809:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787384616 -> 1787384615 00002000:00010000:1.0:1787384616.931791:0:14809:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787384616.931853:0:14809:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+8:2352:x1874208173977856:12345-192.168.203.51@tcp:2:lhsmtool_posix.0 Request processed in 290us (460us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1787384616.931900:0:14809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:0.0:1787384616.939667:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.939752:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173977984 00000100:00100000:2.0:1787384616.939761:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173977984 00000100:00100000:2.0:1787384616.939813:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1787384616.939824:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+8:2350:x1874208173977984:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787384616.939901:0:16306:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.939921:0:16306:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 8 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.939949:0:16306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384616.939954:0:16306:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787384616.939958:0:16306:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.939991:0:16306:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 8 pid: 14811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.940006:0:16306:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 8 pid: 14811 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384616.940023:0:16306:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16306:1874208195980544:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384616.940095:0:16306:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344099180 going to sleep for 11 seconds 00000100:00100000:2.0:1787384616.945515:0:16306:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:16306:1874208195980544:192.168.203.51@tcp:104: 00010000:00010000:2.0:1787384616.945546:0:16306:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384616.950136:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384616.950234:0:16194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173978112 00000100:00100000:3.0:1787384616.950281:0:16194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173978112 00010000:00010000:3.0:1787384616.950324:0:16194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 9 pid: 14811 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384616.950367:0:16194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 14 00000100:00100000:3.0:1787384616.950376:0:16194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:2353:x1874208173978112:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787384616.950389:0:16194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787384616.950418:0:16194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 9 pid: 14811 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.950433:0:16194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 9 pid: 14811 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.950455:0:16194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c49ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79245 expref: 9 pid: 14811 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.950471:0:16194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384616.950476:0:16194:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787384616.950481:0:16194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.950491:0:16194:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.950592:0:16194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787384616.950710:0:16194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+8:2353:x1874208173978112:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 334us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1787384616.950718:0:16194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 14 00010000:00010000:2.0:1787384616.952601:0:16306:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.952745:0:16306:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.952783:0:16306:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.952811:0:16306:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.952823:0:16306:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.952840:0:16306:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384616.952845:0:16306:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.952984:0:16306:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.953008:0:16306:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.953019:0:16306:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c49f3 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16306 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384616.953113:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:2350:x1874208173977984:12345-192.168.203.51@tcp:1:lhsmtool_posix.0 Request processed in 13289us (13454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384616.954086:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:0.0:1787384616.955143:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384616.955245:0:14174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173978368 00000100:00100000:2.0:1787384616.955254:0:14174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173978368 00000100:00100000:2.0:1787384616.955298:0:14174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 53 00000100:00100000:2.0:1787384616.955318:0:14174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+14:14436:x1874208173978368:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787384616.955392:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49fa lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.955417:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.955429:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.955804:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.955816:0:14174:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c49c9 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79230 expref: 15 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.955824:0:14174:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.955856:0:14174:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c49c9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79230 expref: 15 pid: 14173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.955898:0:14174:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c49c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79230 expref: 15 pid: 14173 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384616.955913:0:14174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14174:1874208195980672:192.168.203.51@tcp:104: 00000100:00100000:2.0:1787384616.955996:0:14174:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344099840 going to sleep for 11 seconds 00000100:00100000:0.0:1787384616.958497:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384616.958563:0:14159:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173978496 00000100:00100000:1.0:1787384616.958572:0:14159:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173978496 00010000:00010000:1.0:1787384616.958609:0:14159:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c49c9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79230 expref: 16 pid: 14173 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384616.958709:0:14159:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 15 00000100:00100000:1.0:1787384616.958720:0:14159:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+16:2352:x1874208173978496:12345-192.168.203.51@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787384616.958743:0:14159:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787384616.958751:0:14159:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c49c9 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79230 expref: 16 pid: 14173 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.958766:0:14159:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c49c9 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79230 expref: 16 pid: 14173 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.958790:0:14159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e345695b00) 00010000:00010000:1.0:1787384616.958795:0:14159:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.958804:0:14159:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.958812:0:14159:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.958839:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2200/0x3522fbed3b6c49c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79230 expref: 16 pid: 14173 timeout: 578 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.958844:0:14159:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787384616.958896:0:14174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14174:1874208195980672:192.168.203.51@tcp:104: 00000100:00100000:1.0:1787384616.958927:0:14159:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+15:2352:x1874208173978496:12345-192.168.203.51@tcp:103:ldlm_bl.0 Request processed in 209us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384616.958936:0:14159:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 15 00010000:00010000:2.0:1787384616.959127:0:14174:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.959137:0:14174:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384616.959143:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787384616.959304:0:14174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1787384616.959472:0:14174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1787384616.959515:0:14174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1787384616.959589:0:14174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14174:1874208195980800:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787384616.960453:0:14174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384616.960487:0:14174:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e3440996c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787384616.960645:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195980800 00000100:00100000:0.0:1787384616.960653:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195980800 00000100:00100000:0.0:1787384616.960699:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787384616.960709:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14174:x1874208195980800:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787384616.960799:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14174:x1874208195980800:12345-0@lo:1000:mdt00_001.0 Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384616.960807:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787384616.960926:0:14174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14174:1874208195980800:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1787384616.963009:0:14174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1787384616.963108:0:14174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14174:1874208195980928:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1787384616.963248:0:14174:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787384616.963319:0:14174:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e344099840 going to sleep for 11 seconds 00000100:00100000:0.0:1787384616.963466:0:14178:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195980928 00000100:00100000:0.0:1787384616.963473:0:14178:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195980928 00000100:00100000:0.0:1787384616.963628:0:14178:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787384616.963638:0:14178:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14174:x1874208195980928:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787384616.963883:0:14178:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14174:x1874208195980928:12345-0@lo:1000:mdt00_001.0 Request processed in 246us (634us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787384616.963891:0:14178:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787384616.964090:0:14174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e3460e1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14174:1874208195980928:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1787384616.964194:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964205:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964212:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964219:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384616.964223:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964231:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964246:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e345695b00) 00010000:00010000:3.0:1787384616.964249:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384616.964253:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964260:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb2000/0x3522fbed3b6c4a01 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964308:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964315:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964321:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964326:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3800 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384616.964329:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964464:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964474:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:3.0:1787384616.964477:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787384616.964483:0:14174:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4960 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79214 expref: 18 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964494:0:14174:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4960 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79214 expref: 18 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964503:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4960 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79214 expref: 18 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.964555:0:14174:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fc400/0x3522fbed3b6c4960 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.51@tcp remote: 0x75de5bb77ee79214 expref: 18 pid: 14174 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787384616.964581:0:14174:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14174:1874208195981056:192.168.203.51@tcp:105: 00000100:00100000:3.0:1787384616.964680:0:14174:0:(client.c:2702:ptlrpc_set_wait()) set ffff89e37b2af000 going to sleep for 11 seconds 00000100:00100000:0.0:1787384616.969742:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384616.969915:0:14174:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e37c4e4000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14174:1874208195981056:192.168.203.51@tcp:105: 00010000:00010000:3.0:1787384616.969953:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.969963:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3800/0x3522fbed3b6c4959 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14175 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.969996:0:14174:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4a08 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970011:0:14174:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4a08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970021:0:14174:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4a08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970031:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4a08 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970037:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4a08 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970043:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4a08 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970048:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fde00 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384616.970051:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4a08 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970071:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4a08 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970082:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:3.0:1787384616.970085:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787384616.970088:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4a08 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970093:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e37b8fde00/0x3522fbed3b6c4a08 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970102:0:14174:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49fa lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970108:0:14174:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49fa lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970114:0:14174:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970130:0:14174:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3000 already unused, calling callback (ffffffffc21704f0) 00010000:00010000:3.0:1787384616.970133:0:14174:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49fa lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970139:0:14174:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49fa lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970146:0:14174:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff89e343ce4400) 00010000:00010000:3.0:1787384616.970148:0:14174:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787384616.970151:0:14174:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49fa lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.970166:0:14174:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e379eb3000/0x3522fbed3b6c49fa lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14174 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787384616.970748:0:14208:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787384616.970754:0:14208:0:(llog_cat.c:841:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787384616.970800:0:14208:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787384616.970807:0:14208:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1787384616.970919:0:14174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+18:14436:x1874208173978368:12345-192.168.203.51@tcp:57:lhsmtool_posix.0 Request processed in 15599us (15777us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1787384616.971496:0:14174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 53 00000020:00080000:3.0:1787384616.971505:0:14174:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787384616.973275:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384616.973630:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173978624 00000100:00100000:1.0:1787384616.973640:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173978624 00000100:00100000:1.0:1787384616.973678:0:14176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173978880 00000100:00100000:1.0:1787384616.973681:0:14176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173978880 00000100:00100000:1.0:1787384616.973696:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:1.0:1787384616.973705:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e346bf7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+19:14435:x1874208173978624:12345-192.168.203.51@tcp:49:dd.0 00000100:00100000:1.0:1787384616.973896:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e346bf7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+19:14435:x1874208173978624:12345-192.168.203.51@tcp:49:dd.0 Request processed in 191us (4165us total) trans 0 rc 0/0 00000100:00100000:1.0:1787384616.973904:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 10 00000100:00100000:1.0:1787384616.973959:0:14176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 11 00000100:00100000:1.0:1787384616.973967:0:14176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+18:14436:x1874208173978880:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787384616.974850:0:14176:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787384616.975096:0:14176:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00000100:00100000:2.0:1787384616.975329:0:14177:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:2.0:1787384616.975348:0:14177:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00010000:00010000:1.0:1787384616.975853:0:14176:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.977016:0:14176:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.977030:0:14176:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.977040:0:14176:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.977058:0:14176:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.977064:0:14176:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384616.977132:0:14176:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787384616.977235:0:14176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5d51bcff-d531-4b76-b235-b18c0e21ed53+20:14436:x1874208173978880:12345-192.168.203.51@tcp:35:lhsmtool_posix.0 Request processed in 3265us (3963us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1787384616.977245:0:14176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 11 00000020:00080000:1.0:1787384616.977250:0:14176:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787384616.981101:0:14161:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787384616.981114:0:14161:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.981125:0:14161:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e36624ca00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384616.981129:0:14161:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.981153:0:14161:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.981172:0:14161:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff89e345695b00) 00010000:00010000:3.0:1787384616.981175:0:14161:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787384616.981179:0:14161:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384616.981186:0:14161:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff89e36624ca00/0x3522fbed3b6c4a0f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14176 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384616.982039:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384616.982044:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787384616.982046:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787384617.110253:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:0.0:1787384617.110270:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000100:00100000:0.0:1787384617.192629:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384617.192678:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384617.192804:0:14815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173979008 00000100:00100000:2.0:1787384617.192814:0:14815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173979008 00000100:00100000:2.0:1787384617.192912:0:14815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173979136 00000100:00100000:2.0:1787384617.192916:0:14815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173979136 00000100:00100000:2.0:1787384617.192949:0:14815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1787384617.192968:0:14815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+6:2351:x1874208173979008:12345-192.168.203.51@tcp:4:dd.0 00002000:00010000:2.0:1787384617.193019:0:14815:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a895327, atime: 0x6a895326, ctime: 0x6a895327, blocks: 0x1 00010000:00010000:2.0:1787384617.193029:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a16 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.193045:0:14815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=478s v=(0 0) 00010000:00010000:2.0:1787384617.193049:0:14815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384617.193055:0:14815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.193067:0:14815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384617.194673:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384617.194704:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384617.194726:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:1.0:1787384617.194820:0:14814:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787384617.194822:0:14816:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1787384617.194833:0:14814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1787384617.194838:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173979264 00000100:00100000:3.0:1787384617.194846:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173979264 00000100:00100000:3.0:1787384617.194905:0:14816:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787384617.194912:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173979520 00000100:00100000:3.0:1787384617.194915:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173979520 00000100:00100000:3.0:1787384617.194927:0:14816:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1787384617.194994:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173979392 00000100:00100000:3.0:1787384617.194998:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173979392 00000100:00100000:3.0:1787384617.196325:0:16312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:3.0:1787384617.196338:0:16312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+10:2351:x1874208173979136:12345-192.168.203.51@tcp:4:dd.0 00010000:00010000:3.0:1787384617.196379:0:16312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c4a1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384617.196397:0:16312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384617.196413:0:16312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787384617.196419:0:16312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384617.196433:0:16312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384617.198334:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:0.0:1787384617.198396:0:3298:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384617.198492:0:14814:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1787384617.198502:0:14814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1787384617.199330:0:14816:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787384617.199341:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173979776 00000100:00100000:3.0:1787384617.199350:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173979776 00000100:00100000:3.0:1787384617.199415:0:14816:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787384617.199420:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173979648 00000100:00100000:3.0:1787384617.199423:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173979648 00000100:00100000:2.0:1787384617.200048:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:2.0:1787384617.200062:0:16313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d51bcff-d531-4b76-b235-b18c0e21ed53+13:2350:x1874208173979264:12345-192.168.203.51@tcp:4:dd.0 00010000:00010000:2.0:1787384617.200098:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c4a24 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.200114:0:16313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384617.200129:0:16313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384617.200136:0:16313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.200150:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384617.206821:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:3.0:1787384617.207086:0:14816:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1787384617.207107:0:14816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1787384617.207482:0:14816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173979904 00000100:00100000:1.0:1787384617.207491:0:14816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173979904 00000100:00100000:0.0:1787384617.210358:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:0.0:1787384617.210378:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5d51bcff-d531-4b76-b235-b18c0e21ed53+15:2351:x1874208173979520:12345-192.168.203.51@tcp:4:dd.0 00010000:00010000:0.0:1787384617.210436:0:16314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f5fb267/0x3522fbed3b6c4a2b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.210455:0:16314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384617.210459:0:16314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384617.210466:0:16314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007f5fb267/0x3522fbed3b6c4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.210481:0:16314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007f5fb267/0x3522fbed3b6c4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384617.290211:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787384617.299489:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1787384617.301047:0:14815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 5242880 00002000:00010000:2.0:1787384617.301056:0:14815:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787384615 -> 1787384616 00002000:00010000:2.0:1787384617.301059:0:14815:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787384615 -> 1787384616 00002000:00010000:2.0:1787384617.301061:0:14815:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:2.0:1787384617.301076:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a16 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.301090:0:14815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a16 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.301100:0:14815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.301107:0:14815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384617.301113:0:14815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a16 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.301203:0:14815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a16 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.301226:0:14815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a16 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.301233:0:14815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a16 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384617.301332:0:14815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+21:2351:x1874208173979008:12345-192.168.203.51@tcp:4:dd.0 Request processed in 108363us (108707us total) trans 8589934598 rc 0/0 00000100:00100000:2.0:1787384617.301343:0:14815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 0 00000100:00100000:2.0:1787384617.301374:0:14815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 4 00000100:00100000:2.0:1787384617.301385:0:14815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+20:2351:x1874208173979392:12345-192.168.203.51@tcp:4:dd.0 00010000:00010000:2.0:1787384617.301428:0:14815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056bff678/0x3522fbed3b6c4a32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.301441:0:14815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384617.301445:0:14815:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384617.301451:0:14815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000056bff678/0x3522fbed3b6c4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.301463:0:14815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000056bff678/0x3522fbed3b6c4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787384617.354924:0:16312:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:2.0:1787384617.355220:0:16314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007f5fb267/0x3522fbed3b6c4a2b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.355234:0:16314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007f5fb267/0x3522fbed3b6c4a2b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.355244:0:16314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007f5fb267/0x3522fbed3b6c4a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.355347:0:16314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ae00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384617.355353:0:16314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007f5fb267/0x3522fbed3b6c4a2b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.355365:0:16314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007f5fb267/0x3522fbed3b6c4a2b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.355384:0:16314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007f5fb267/0x3522fbed3b6c4a2b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.355392:0:16314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007f5fb267/0x3522fbed3b6c4a2b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384617.355494:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5d51bcff-d531-4b76-b235-b18c0e21ed53+22:2351:x1874208173979520:12345-192.168.203.51@tcp:4:dd.0 Request processed in 145119us (160785us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1787384617.355505:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 3 00000100:00100000:2.0:1787384617.355536:0:16314:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 5 00000100:00100000:2.0:1787384617.355548:0:16314:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5d51bcff-d531-4b76-b235-b18c0e21ed53+21:2351:x1874208173979776:12345-192.168.203.51@tcp:4:dd.0 00010000:00010000:2.0:1787384617.355577:0:16314:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a39 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.355589:0:16314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384617.355593:0:16314:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384617.355600:0:16314:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.355624:0:16314:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384617.357220:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c4a24 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384617.357237:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c4a24 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384617.357246:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c4a24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384617.357253:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3c00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:3.0:1787384617.357258:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c4a24 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384617.357267:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c4a24 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384617.357412:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:1.0:1787384617.357437:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00010000:00010000:0.0:1787384617.357479:0:16312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c4a1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.357490:0:16312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c4a1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.357498:0:16312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c4a1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.357505:0:16312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e37b8fde00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384617.357509:0:16312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c4a1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.357536:0:16312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c4a1d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.357555:0:16312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c4a1d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.357564:0:16312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eae89f41/0x3522fbed3b6c4a1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384617.357667:0:16312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+15:2351:x1874208173979136:12345-192.168.203.51@tcp:4:dd.0 Request processed in 161328us (164984us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1787384617.357677:0:16312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 1 00000100:00100000:0.0:1787384617.357704:0:16312:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 6 00000100:00100000:0.0:1787384617.357716:0:16312:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e379fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+14:2351:x1874208173979648:12345-192.168.203.51@tcp:4:dd.0 00010000:00010000:0.0:1787384617.357744:0:16312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064c2d85/0x3522fbed3b6c4a40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 6 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.357839:0:16312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384617.357844:0:16312:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787384617.357850:0:16312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000064c2d85/0x3522fbed3b6c4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.357883:0:16312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000064c2d85/0x3522fbed3b6c4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384617.360749:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c4a24 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787384617.360837:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000235910d6/0x3522fbed3b6c4a24 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384617.362592:0:16313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d51bcff-d531-4b76-b235-b18c0e21ed53+14:2350:x1874208173979264:12345-192.168.203.51@tcp:4:dd.0 Request processed in 162523us (167916us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1787384617.362605:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 2 00000100:00100000:2.0:1787384617.362637:0:16313:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 7 00000100:00100000:2.0:1787384617.362649:0:16313:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d51bcff-d531-4b76-b235-b18c0e21ed53+13:2351:x1874208173979904:12345-192.168.203.51@tcp:4:dd.0 00010000:00010000:2.0:1787384617.362684:0:16313:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4a47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.362698:0:16313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384617.362701:0:16313:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787384617.362707:0:16313:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.362719:0:16313:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787384617.401208:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:2.0:1787384617.402720:0:14815:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:2.0:1787384617.402728:0:14815:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:2.0:1787384617.402743:0:14815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000056bff678/0x3522fbed3b6c4a32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.402768:0:14815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000056bff678/0x3522fbed3b6c4a32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.402790:0:14815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000056bff678/0x3522fbed3b6c4a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.402796:0:14815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb3000 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384617.402801:0:14815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000056bff678/0x3522fbed3b6c4a32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.402810:0:14815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000056bff678/0x3522fbed3b6c4a32 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.402833:0:14815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000056bff678/0x3522fbed3b6c4a32 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.402840:0:14815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000056bff678/0x3522fbed3b6c4a32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14815 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384617.402972:0:14815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fca300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:5d51bcff-d531-4b76-b235-b18c0e21ed53+17:2351:x1874208173979392:12345-192.168.203.51@tcp:4:dd.0 Request processed in 101586us (208241us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1787384617.402981:0:14815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 4 00000001:00080000:1.0:1787384617.438896:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:1.0:1787384617.439055:0:16314:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 14343 00010000:00010000:1.0:1787384617.439072:0:16314:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a39 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384617.439085:0:16314:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a39 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384617.439094:0:16314:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384617.439122:0:16314:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2200 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:1.0:1787384617.439127:0:16314:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a39 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384617.439135:0:16314:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a39 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384617.439155:0:16314:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a39 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787384617.439163:0:16314:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006ee021d1/0x3522fbed3b6c4a39 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16314 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787384617.439252:0:16314:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fc9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:5d51bcff-d531-4b76-b235-b18c0e21ed53+11:2351:x1874208173979776:12345-192.168.203.51@tcp:4:dd.0 Request processed in 83703us (240921us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1787384617.439261:0:16314:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 5 00010000:00010000:0.0:1787384617.439574:0:16312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000064c2d85/0x3522fbed3b6c4a40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.439584:0:16312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000064c2d85/0x3522fbed3b6c4a40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.439592:0:16312:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000064c2d85/0x3522fbed3b6c4a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.439598:0:16312:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e35108ba00 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:0.0:1787384617.439602:0:16312:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000064c2d85/0x3522fbed3b6c4a40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.439614:0:16312:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000064c2d85/0x3522fbed3b6c4a40 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.439626:0:16312:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000064c2d85/0x3522fbed3b6c4a40 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787384617.439633:0:16312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000064c2d85/0x3522fbed3b6c4a40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787384617.439669:0:16312:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e379fcb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+9:2351:x1874208173979648:12345-192.168.203.51@tcp:4:dd.0 Request processed in 81956us (241271us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1787384617.439676:0:16312:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 6 00002000:00010000:2.0:1787384617.463122:0:16313:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:2.0:1787384617.463143:0:16313:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4a47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.463156:0:16313:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4a47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.463177:0:16313:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.463185:0:16313:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff89e379eb2000 already unused, calling callback (ffffffffc1734e90) 00010000:00010000:2.0:1787384617.463190:0:16313:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4a47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.463200:0:16313:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4a47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.463220:0:16313:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4a47 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787384617.463228:0:16313:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035645ea4/0x3522fbed3b6c4a47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16313 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787384617.463362:0:16313:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:5d51bcff-d531-4b76-b235-b18c0e21ed53+7:2351:x1874208173979904:12345-192.168.203.51@tcp:4:dd.0 Request processed in 100712us (256545us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1787384617.463373:0:16313:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 7 00000001:00080000:2.0:1787384617.463419:0:7483:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:0.0:1787384618.313095:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787384619.105171:0:16351:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:3.0:1787384619.337174:0:14162:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787384619.593654:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787384619.593676:0:3305:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff89e379fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195981184:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787384619.593741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787384619.594043:0:14812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208195981184 00000100:00100000:0.0:1787384619.594051:0:14812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208195981184 00000100:00080000:1.0:1787384619.594522:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787384619.595455:0:14812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787384619.595467:0:14812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37c4e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195981184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787384619.595504:0:14812:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787384619.595574:0:14812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37c4e4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1874208195981184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1833us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384619.595580:0:14812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787384619.595732:0:3305:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff89e379fcaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3305:1874208195981184:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787384619.679711:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384619.679759:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384619.679793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384619.679826:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384619.679845:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384619.679911:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384619.679942:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.51@tcp (source: 12345-192.168.203.51@tcp) 00000100:00100000:2.0:1787384619.679968:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173980416 00000100:00100000:2.0:1787384619.679989:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173980416 00000100:00100000:0.0:1787384619.680016:0:14165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173980032 00000100:00100000:0.0:1787384619.680023:0:14165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173980032 00000100:00100000:2.0:1787384619.680050:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173980288 00000100:00100000:2.0:1787384619.680055:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173980288 00000100:00100000:0.0:1787384619.680062:0:14165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:2.0:1787384619.680077:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173980672 00000100:00100000:2.0:1787384619.680081:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173980672 00000100:00100000:0.0:1787384619.680085:0:14165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e374900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:2352:x1874208173980032:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384619.680096:0:16306:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173980800 00000100:00100000:2.0:1787384619.680100:0:16306:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173980800 00000100:00100000:2.0:1787384619.680116:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:2.0:1787384619.680125:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2353:x1874208173980416:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384619.680156:0:14165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e374900850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:1cf36f9e-bc75-4227-b914-014ee123b1de+13:2352:x1874208173980032:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 83us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384619.680163:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2353:x1874208173980416:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 39us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787384619.680173:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 17 00000100:00100000:0.0:1787384619.680181:0:14165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 121 00000100:00100000:2.0:1787384619.680194:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1787384619.680203:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e37315c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2352:x1874208173980288:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384619.680227:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173980160 00000100:00100000:2.0:1787384619.680231:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e37315c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5d51bcff-d531-4b76-b235-b18c0e21ed53+5:2352:x1874208173980288:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 28us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384619.680233:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173980160 00000100:00100000:2.0:1787384619.680241:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 18 00000100:00100000:2.0:1787384619.680258:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:2.0:1787384619.680266:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2353:x1874208173980672:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384619.680267:0:14175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874208173980544 00000100:00100000:0.0:1787384619.680272:0:14175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874208173980544 00000100:00100000:2.0:1787384619.680298:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2353:x1874208173980672:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384619.680300:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:2.0:1787384619.680313:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 19 00000100:00100000:0.0:1787384619.680314:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3460e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+20:2353:x1874208173980160:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384619.680348:0:16306:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:0.0:1787384619.680353:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3460e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5d51bcff-d531-4b76-b235-b18c0e21ed53+20:2353:x1874208173980160:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 43us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384619.680363:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 30 00000100:00100000:2.0:1787384619.680368:0:16306:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2352:x1874208173980800:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:0.0:1787384619.680400:0:14175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00100000:2.0:1787384619.680409:0:16306:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+5:2352:x1874208173980800:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 44us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384619.680410:0:14175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff89e3779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2352:x1874208173980544:12345-192.168.203.51@tcp:400:kworker.0 00000100:00100000:2.0:1787384619.680424:0:16306:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 20 00000100:00100000:0.0:1787384619.680449:0:14175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff89e3779f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:ef19089e-b2ce-45c8-b7f7-153fd5841ca9+6:2352:x1874208173980544:12345-192.168.203.51@tcp:400:kworker.0 Request processed in 42us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1787384619.680456:0:14175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.51@tcp, seq: 31 00000100:00080000:1.0:1787384619.681623:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787384619.681630:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787384619.681633:0:14169:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1787384620.361068:0:14161:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29715 lines, 29715 kept, 0 dropped, 0 bad.